-- Logs begin at Wed 2022-08-31 08:58:27 UTC, end at Wed 2022-08-31 10:12:54 UTC. -- Aug 31 09:31:25.459070 dv-cinder-844961-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 09:31:25.466357 dv-cinder-844961-2-smb devstack@keystone.service[88087]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 09:31:25 2022] *** Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: nodename: dv-cinder-844961-2-smb Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: machine: x86_64 Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: clock source: unix Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: pcre jit disabled Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: detected number of CPU cores: 4 Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: current working directory: / Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: detected binary path: /usr/bin/uwsgi-core Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: your processes number limit is 47680 Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: your memory page size is 4096 bytes Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: detected max file descriptor number: 2048 Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: lock engine: pthread robust mutexes Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: thunder lock: enabled Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 09:31:25.472198 dv-cinder-844961-2-smb devstack@keystone.service[88087]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 09:31:25.510795 dv-cinder-844961-2-smb devstack@keystone.service[88087]: Python main interpreter initialized at 0x55aadc5b89c0 Aug 31 09:31:25.510795 dv-cinder-844961-2-smb devstack@keystone.service[88087]: python threads support enabled Aug 31 09:31:25.510795 dv-cinder-844961-2-smb devstack@keystone.service[88087]: your server socket listen backlog is limited to 100 connections Aug 31 09:31:25.510795 dv-cinder-844961-2-smb devstack@keystone.service[88087]: your mercy for graceful operations on workers is 90 seconds Aug 31 09:31:25.511182 dv-cinder-844961-2-smb devstack@keystone.service[88087]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 09:31:25.511270 dv-cinder-844961-2-smb devstack@keystone.service[88087]: *** Operational MODE: preforking *** Aug 31 09:31:25.511485 dv-cinder-844961-2-smb devstack@keystone.service[88087]: *** uWSGI is running in multiple interpreter mode *** Aug 31 09:31:25.511485 dv-cinder-844961-2-smb devstack@keystone.service[88087]: spawned uWSGI master process (pid: 88087) Aug 31 09:31:25.511696 dv-cinder-844961-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 09:31:25.512806 dv-cinder-844961-2-smb devstack@keystone.service[88087]: spawned uWSGI worker 1 (pid: 88101, cores: 1) Aug 31 09:31:25.512806 dv-cinder-844961-2-smb devstack@keystone.service[88087]: spawned uWSGI worker 2 (pid: 88102, cores: 1) Aug 31 09:31:25.512806 dv-cinder-844961-2-smb devstack@keystone.service[88087]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 09:31:29.824253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:31:29.824253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: from cryptography.utils import int_from_bytes Aug 31 09:31:29.825035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:31:29.825035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: from cryptography.utils import int_from_bytes Aug 31 09:31:29.825482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:31:29.825482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: from cryptography.utils import int_from_bytes Aug 31 09:31:29.825613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 09:31:29.825613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: from cryptography.utils import int_from_bytes Aug 31 09:31:29.874301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:31:29.874595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:31:29.874792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] command line args: [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:31:29.875063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:31:29.875238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ================================================================================ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:31:29.875487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] admin_token = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.875565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 09:31:29.875727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] config_dir = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.875811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 09:31:29.875912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.876118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] command line args: [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 09:31:29.876242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] config_source = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.876331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 09:31:29.876409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] debug = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.876481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ================================================================================ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 09:31:29.876557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.877724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] admin_token = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.877800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.877861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] config_dir = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.877919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.877981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.877981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] config_source = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] debug = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] log_config_append = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] log_dir = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] log_file = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.878960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] log_config_append = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] log_dir = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] log_file = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.879948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.880862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.881014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.881096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.881249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.881333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.881481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.881607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.881739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.881931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.882058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.882183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.882303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] publish_errors = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.882425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.882536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.882649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.882770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.882891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] publish_errors = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] standard_threads = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.883973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.884088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.884228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.884356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.884479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] use_journal = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.884594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.884709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] use_json = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.884709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] use_stderr = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.884922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] standard_threads = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.885036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] use_syslog = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.885214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.885338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.885454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.885568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.885683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.885803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.885929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] use_journal = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.885929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] use_json = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.886150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.886255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] use_stderr = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.886367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.886481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] use_syslog = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.886603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.886724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 09:31:29.886844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.886964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.887085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.887204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.887327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.887447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.887566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.887687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.887809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.887923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.888046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.888181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.888298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.888423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.888550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.888666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.888788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.888904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.889017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.889131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.889244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.889461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.890182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.890413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.890548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.890666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.890780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.890893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.891017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.891132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.891245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.891358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.891472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.891592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.891783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.891901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.892988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.893217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.893337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.893452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.893564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.893678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.893803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.893918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.894960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.895081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.895205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.895325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.895440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.895813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.895930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.896049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.896195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.896312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.896425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.896538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.896651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.896763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.896888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.897999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.898112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.898225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.898347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.898461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.898574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.898687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.898806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.898920 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.899969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.900071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.900229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.900343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.900453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.900594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.900700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.900838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.900945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.901053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.901178 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.901294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.901410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.901523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.901638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.901752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.901865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.902367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.902494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.902610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.902726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.902850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.902962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.903088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.903204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.903319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.903444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.903552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.903665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.903788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.903893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.904991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.905113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.905275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.905409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.905534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.905651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.905766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.905887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.906928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.907142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.907142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.907466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.907583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.907701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.907816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.907931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.908046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.908221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.908351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.908469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.908584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.908700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.908816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.908939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.909061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.909177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.909298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.909421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.909546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.909736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.909856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.909971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.910086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.910210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.910335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.910335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.910560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.910676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.910791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.910907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.911968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.912084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.912220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.912338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.912468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.external = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.912585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.912709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.912825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.912947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.password = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] auth.token = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.913932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.914150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.914266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.914391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.914508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.914625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.external = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.914747 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.914865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.914980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.915105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.915224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.915340 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.915456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.915578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.password = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.915701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.915826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] auth.token = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.915949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.916067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.916205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.916324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.916440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.916567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.916767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.916913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917632 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.917980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.918104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.918222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.918339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.918456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.918572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.918688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.918813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.918946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.919089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.919089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.919309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.919309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.919535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.919652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.919768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.919892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.920010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.920126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.920281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.920400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.920516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.925951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.926885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.927974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928200 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.928989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.929997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.930951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931551 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.931973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.932965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.933958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.934116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.934194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.934349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.934427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.934589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.934668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.934828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.934904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.935066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.935143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.935304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.935383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.935545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.935630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.935772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.935850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.936016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.936096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.936862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.936948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.937123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.937230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.937362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.937468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.937600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.937704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.937832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.937950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.938080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.938196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.938329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.938432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.938575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.938683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.938821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.938900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.939068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.939146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.939300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.939377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.939546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.939626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.939784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.939863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.940020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.940149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.940270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.940440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.940519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.940675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.940817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.940915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.941066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.941192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.941318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.941395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.941547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.941631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.941779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.941858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.942983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] role.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] role.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.943990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.944201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.944284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.944441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.944567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.944724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.944800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.944919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.944998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.945163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.945248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.945406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.945484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.945648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.945726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.945893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.945978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.946121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.946199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.946357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] role.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.946437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.946598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.946684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] role.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.946829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.946913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.947073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.947150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.947318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.947470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.947550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.947705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.947783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.947952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.948030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.948225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.948310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.948474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.948552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.948722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.948800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.948954 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.949992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.950141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.950328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.950457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.950557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.950691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.950806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.950885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.951055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.951135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.951288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.951366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.951521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.951598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.951773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.951853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.952013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] token.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.952225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.952299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.952507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.952596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.952743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.952823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.952995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.953072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.953230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.953316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.953462 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.953539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.953703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.953781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.953944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.954965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.955127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.955205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] token.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.955401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.955488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.955630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.955717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.955868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.955948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.956124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.956239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.956399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.956480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.956638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.956716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.956881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.956958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.957113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.957195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.957348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.957427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.957580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.957658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.957816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.957894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958516 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.958986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.959074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.959217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.959295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.959460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.959539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.959691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.959770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.959932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.960010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.960204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.960288 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.960426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.960505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.960659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.960737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.960821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88101) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:31:29.960896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.961117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.961355 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.961599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.961837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.962080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.962315 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.962563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.962800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.963045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.963276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.963516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.963750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 09:31:29.963920 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88102) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 09:31:29.990491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:29.990661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:29.990885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:29.993119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:29.993353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:29.993578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:29.999811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.002637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.028768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.028994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.029130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.029365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.083922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.084105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.133023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.133249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.133945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.134179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.289876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.290939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.291058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.314400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.314591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.314691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.314854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.314964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.315916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.327031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.327140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.339770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.340923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.341005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.341135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88102) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.341216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.341353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88101) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 09:31:30.359285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.359489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 09:31:30.359826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.359913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.360022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 09:31:30.360104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 09:31:30.360322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.360408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.360571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 09:31:30.360658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.360847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.361082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.361165 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.361346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.361426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.361599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.370735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.371017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.371166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.371288 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.371443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.371571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.371713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.371995 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.378655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.379134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.381597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.381882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.382057 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.382167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.382340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.382456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.382621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.382743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.382903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.383006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.383185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.383265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.383445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.383526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.383718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.383911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.383999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.384220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.384304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.384498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.384578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.384787 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.408031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.408564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.409534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.409821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.410036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.410337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.414508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.414793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.414874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.415076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.415157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.415420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.421623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.421912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.422083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.422367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.426024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.426318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.426400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.426605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.426687 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.426886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.426976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.427162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.427243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.427432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.427511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.427702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.427977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.429403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.429696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.429981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.445663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.446000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.446085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.446277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.450099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.450188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.454012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.454110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.454306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.454388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.458601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.458698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.461788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.461878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.464939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.465068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.465239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.465376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.465525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.465667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.465806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.465955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.466100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.466243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.466480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.466575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.482332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.482547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.482633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.482861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.482941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.483144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.483239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.483440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.489896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.490390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.491551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.491942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.493135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.493411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.493524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.493803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.496053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.496361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.496488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.496654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.496784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.496939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.497179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.497262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.497467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.498325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.509140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.509426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.509591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.509704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.509885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.509967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.510241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.510322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.510514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.510600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.510809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.510897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.511102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.511394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.526657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.527292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.530391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.530862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.533316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.533787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.534767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.535235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.536274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.536558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.536855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.536938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.537162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.537466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.543525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.543951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.545203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.545593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.548089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.548413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.548639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.548721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.548942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.549024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.549230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.549510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.556941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.557231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.557508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.557609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.557802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.558083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.565005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88101) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.565289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.565572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.565670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88102) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 09:31:30.565848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.565934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.566125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.566211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.566408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.566491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.566686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.566768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.566965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.567060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.567242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.567326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.567520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.567610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.567785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.567865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.568046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.568127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.568345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.568430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.568608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.568688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88101) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.568877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.569156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88102) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 09:31:30.604523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aadc5b89c0 pid: 88102 (default app) Aug 31 09:31:30.604823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aadc5b89c0 pid: 88101 (default app) Aug 31 09:31:30.608508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce9c84-0e57-4934-8da9-5fddb853f052 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:30.608796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce9c84-0e57-4934-8da9-5fddb853f052 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:30.609070 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce9c84-0e57-4934-8da9-5fddb853f052 None None] PATH_INFO: `/v3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:30.613255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Wed Aug 31 09:31:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:37.203805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304adfd-58d5-473a-b114-0932886ee579 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:37.204344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304adfd-58d5-473a-b114-0932886ee579 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:37.204477 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304adfd-58d5-473a-b114-0932886ee579 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:37.209387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1/2] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:31:37.214933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:37.215379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:37.215516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:37.286864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: INFO dbcounter [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] Registered counter for database keystone Aug 31 09:31:37.305359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG oslo_db.sqlalchemy.engines [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88102) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:31:37.311487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writer thread running {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:31:37.491259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG passlib.handlers.bcrypt [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88102) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 09:31:37.491569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG passlib.handlers.bcrypt [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88102) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 09:31:37.551274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:37.552915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:37.681241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 2/3] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 09:31:38.085248 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304adfd-58d5-473a-b114-0932886ee579 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:38.155692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: INFO dbcounter [None req-e304adfd-58d5-473a-b114-0932886ee579 None None] Registered counter for database keystone Aug 31 09:31:38.177532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG oslo_db.sqlalchemy.engines [None req-e304adfd-58d5-473a-b114-0932886ee579 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88101) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 09:31:38.183710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writer thread running {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 09:31:38.302284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304adfd-58d5-473a-b114-0932886ee579 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:38.306621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0bc280-03b6-4ca5-8d46-000a8fe50175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:38.307240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc280-03b6-4ca5-8d46-000a8fe50175 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:38.307521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc280-03b6-4ca5-8d46-000a8fe50175 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:38.307792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0bc280-03b6-4ca5-8d46-000a8fe50175 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:38.315808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bc280-03b6-4ca5-8d46-000a8fe50175 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:38.367720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1d0bc280-03b6-4ca5-8d46-000a8fe50175 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 09:31:38.368060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0bc280-03b6-4ca5-8d46-000a8fe50175 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:38.378022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 2/4] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Aug 31 09:31:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 09:31:38.384376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:38.399238 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd5d6b-4e6b-47e3-8032-056608352f89 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:38.403661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6037978f-7794-4fbe-9902-ea243052ecb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:38.404786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037978f-7794-4fbe-9902-ea243052ecb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:38.405068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037978f-7794-4fbe-9902-ea243052ecb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:38.405337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037978f-7794-4fbe-9902-ea243052ecb2 admin admin] PATH_INFO: `/v3/projects/e7cebf42df3d496db8970830cfea66a2` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:38.406920 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037978f-7794-4fbe-9902-ea243052ecb2 admin admin] RBAC: Authorizing `identity:get_project(project_id=e7cebf42df3d496db8970830cfea66a2)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:38.460233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6037978f-7794-4fbe-9902-ea243052ecb2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 09:31:38.460582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6037978f-7794-4fbe-9902-ea243052ecb2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:38.465065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 3/5] 10.222.0.18 () {56 vars in 1207 bytes} [Wed Aug 31 09:31:38 2022] GET /identity/v3/projects/e7cebf42df3d496db8970830cfea66a2 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:40.353074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6685-e500-44e9-ad2b-496c16dcec94 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:40.353621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6685-e500-44e9-ad2b-496c16dcec94 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:40.353621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d6685-e500-44e9-ad2b-496c16dcec94 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:40.358510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 3/6] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:40.363952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef099a1b-177d-4ec9-9cd8-fe10a1647c57 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:40.364385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef099a1b-177d-4ec9-9cd8-fe10a1647c57 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:40.364550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef099a1b-177d-4ec9-9cd8-fe10a1647c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:40.385289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ef099a1b-177d-4ec9-9cd8-fe10a1647c57 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:40.386806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ef099a1b-177d-4ec9-9cd8-fe10a1647c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:40.394796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 4/7] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 09:31:40.660482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6685-e500-44e9-ad2b-496c16dcec94 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:40.673113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d6685-e500-44e9-ad2b-496c16dcec94 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:40.677302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fbfba2-2973-4209-a5ac-3f7dbc4e275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:40.677899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbfba2-2973-4209-a5ac-3f7dbc4e275b admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:40.678179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbfba2-2973-4209-a5ac-3f7dbc4e275b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:40.678450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fbfba2-2973-4209-a5ac-3f7dbc4e275b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:40.687035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbfba2-2973-4209-a5ac-3f7dbc4e275b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:40.688849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fbfba2-2973-4209-a5ac-3f7dbc4e275b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:40.697449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 4/8] 10.222.0.18 () {58 vars in 1324 bytes} [Wed Aug 31 09:31:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:31:40.703014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef099a1b-177d-4ec9-9cd8-fe10a1647c57 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:40.711979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef099a1b-177d-4ec9-9cd8-fe10a1647c57 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:40.716915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28455a38-d3ca-441f-8c6f-21291100e09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:40.717535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28455a38-d3ca-441f-8c6f-21291100e09a admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:40.717823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28455a38-d3ca-441f-8c6f-21291100e09a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:40.718096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28455a38-d3ca-441f-8c6f-21291100e09a admin admin] PATH_INFO: `/v3/users/07cf079d1e524f8aa193b1bfe9096586` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:40.719425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28455a38-d3ca-441f-8c6f-21291100e09a admin admin] RBAC: Authorizing `identity:get_user(user_id=07cf079d1e524f8aa193b1bfe9096586)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:40.721331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28455a38-d3ca-441f-8c6f-21291100e09a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:40.723036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 5/9] 10.222.0.18 () {56 vars in 1198 bytes} [Wed Aug 31 09:31:40 2022] GET /identity/v3/users/07cf079d1e524f8aa193b1bfe9096586 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:42.680092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a4a16-3839-47a5-abf3-f5faf621b3ef None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:42.680658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a4a16-3839-47a5-abf3-f5faf621b3ef None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:42.680658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a4a16-3839-47a5-abf3-f5faf621b3ef None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:42.682528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 5/10] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:42.687642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028d3b-e30a-4c5b-9de0-4c91bd856512 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:42.688088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028d3b-e30a-4c5b-9de0-4c91bd856512 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:42.688231 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028d3b-e30a-4c5b-9de0-4c91bd856512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:42.707918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-23028d3b-e30a-4c5b-9de0-4c91bd856512 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:42.709148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-23028d3b-e30a-4c5b-9de0-4c91bd856512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:42.735037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414a10-b2fc-4a04-87a6-fbfa257625df None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:42.735322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414a10-b2fc-4a04-87a6-fbfa257625df None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:42.735597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e414a10-b2fc-4a04-87a6-fbfa257625df None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:42.736931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 6/11] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:31:42.741917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:42.742195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:42.742470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:42.785739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG passlib.handlers.bcrypt [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88101) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 09:31:42.786131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG passlib.handlers.bcrypt [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88101) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 09:31:42.791011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 6/12] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:42.835710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:42.837312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:42.941960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 7/13] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:31:43.059991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028d3b-e30a-4c5b-9de0-4c91bd856512 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:43.083851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:43.163834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028d3b-e30a-4c5b-9de0-4c91bd856512 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:43.197536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a35fed-95b5-432c-919b-3344503dbe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:43.198096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a35fed-95b5-432c-919b-3344503dbe36 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:43.198377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a35fed-95b5-432c-919b-3344503dbe36 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:43.198650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a35fed-95b5-432c-919b-3344503dbe36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:43.209313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a35fed-95b5-432c-919b-3344503dbe36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:31:43.210303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-58a35fed-95b5-432c-919b-3344503dbe36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:31:43.218582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:43.219572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:31:43.220445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 7/14] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:31:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:31:43.225277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a35fed-95b5-432c-919b-3344503dbe36 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:43.307226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:43.311733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47444885-4bf0-44f7-8fc0-9ba7ce5e0f0e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:43.314070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:43.326635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a35fed-95b5-432c-919b-3344503dbe36 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:43.349170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe69c0-c6f4-47cf-acf7-52d1e6bf1db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:43.350032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe69c0-c6f4-47cf-acf7-52d1e6bf1db9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:43.350317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe69c0-c6f4-47cf-acf7-52d1e6bf1db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:43.350600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe69c0-c6f4-47cf-acf7-52d1e6bf1db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:43.360422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:43.361025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:43.361303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:43.361577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:43.362249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:43.362547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:43.364038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:43.376712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 8/15] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:31:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:43.382104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:43.419233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe69c0-c6f4-47cf-acf7-52d1e6bf1db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:43.420795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe69c0-c6f4-47cf-acf7-52d1e6bf1db9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:43.480731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd12ea-c33a-46b6-8e60-a94466a6a01a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:43.515916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b052-43a0-426b-a683-c61b112a5994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:43.516099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 8/16] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:31:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 09:31:43.516570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b052-43a0-426b-a683-c61b112a5994 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:43.516852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b052-43a0-426b-a683-c61b112a5994 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:43.517124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915b052-43a0-426b-a683-c61b112a5994 None admin] PATH_INFO: `/v3/users/07cf079d1e524f8aa193b1bfe9096586` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:43.518278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915b052-43a0-426b-a683-c61b112a5994 None admin] RBAC: Authorizing `identity:get_user(user_id=07cf079d1e524f8aa193b1bfe9096586)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:43.519756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b915b052-43a0-426b-a683-c61b112a5994 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:43.521334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 9/17] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:31:43 2022] GET /identity/v3/users/07cf079d1e524f8aa193b1bfe9096586 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:43.521724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe69c0-c6f4-47cf-acf7-52d1e6bf1db9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:43.524567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:43.526952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b052-43a0-426b-a683-c61b112a5994 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:43.542414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:43.622020 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe69c0-c6f4-47cf-acf7-52d1e6bf1db9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:43.628695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915b052-43a0-426b-a683-c61b112a5994 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:43.656205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:43.657042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:43.657321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:43.657595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:43.663190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f84b6-ed0d-4f02-a0f7-f33382376cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:43.663810 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f84b6-ed0d-4f02-a0f7-f33382376cf5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:43.664109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f84b6-ed0d-4f02-a0f7-f33382376cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:43.664408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f84b6-ed0d-4f02-a0f7-f33382376cf5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:43.665563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f84b6-ed0d-4f02-a0f7-f33382376cf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:43.667017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f84b6-ed0d-4f02-a0f7-f33382376cf5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:43.668594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 10/18] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:43.674232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f84b6-ed0d-4f02-a0f7-f33382376cf5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:43.676486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:43.678989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:31:43.699854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:43.701224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:31:43.702039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:31:43.702039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:31:43.702039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:31:43.702039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 9/19] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:31:43.706710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:43.758186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:43.762810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:43.777848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f84b6-ed0d-4f02-a0f7-f33382376cf5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:43.807327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e0ae1-ebba-42c5-b8d1-0af5498cf0a3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:43.810865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c2ffd-5bdf-4fa6-9ef1-037f4c8ec5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:43.811463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c2ffd-5bdf-4fa6-9ef1-037f4c8ec5e8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:43.811742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c2ffd-5bdf-4fa6-9ef1-037f4c8ec5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:43.812013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c2ffd-5bdf-4fa6-9ef1-037f4c8ec5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:43.812757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c2ffd-5bdf-4fa6-9ef1-037f4c8ec5e8 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.domain.id=default, user.id=07cf079d1e524f8aa193b1bfe9096586) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:43.813059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c2ffd-5bdf-4fa6-9ef1-037f4c8ec5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:43.814499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c2ffd-5bdf-4fa6-9ef1-037f4c8ec5e8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:43.822032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 11/20] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Aug 31 09:31:43 2022] GET /identity/v3/role_assignments?user.id=07cf079d1e524f8aa193b1bfe9096586&scope.domain.id=default&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:43.841856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af47f88-8b98-46af-bb49-e40edf8b2297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:43.842491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47f88-8b98-46af-bb49-e40edf8b2297 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:43.842766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47f88-8b98-46af-bb49-e40edf8b2297 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:43.843034 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af47f88-8b98-46af-bb49-e40edf8b2297 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:43.843697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af47f88-8b98-46af-bb49-e40edf8b2297 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:43.843998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af47f88-8b98-46af-bb49-e40edf8b2297 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:43.845457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af47f88-8b98-46af-bb49-e40edf8b2297 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:43.864935 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 10/21] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:46.136844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c314935-deec-4024-88ca-e59499f8b841 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.137886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c314935-deec-4024-88ca-e59499f8b841 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.138392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c314935-deec-4024-88ca-e59499f8b841 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.139954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 12/22] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:46.145503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b879a-d72f-444d-bd7c-da77ae98bc44 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.146943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b879a-d72f-444d-bd7c-da77ae98bc44 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.147432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b879a-d72f-444d-bd7c-da77ae98bc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.173194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-261b879a-d72f-444d-bd7c-da77ae98bc44 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:46.174423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-261b879a-d72f-444d-bd7c-da77ae98bc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:46.233592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a1ec0-0d5b-4e2b-9daf-c4cde9ae36ec None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.234225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a1ec0-0d5b-4e2b-9daf-c4cde9ae36ec None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.234795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a1ec0-0d5b-4e2b-9daf-c4cde9ae36ec None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.238157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 13/23] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:31:46.257604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b715c-3dc0-48a4-b78f-f0faa3185a57 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.258194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b715c-3dc0-48a4-b78f-f0faa3185a57 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.258703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b715c-3dc0-48a4-b78f-f0faa3185a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.265570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 11/24] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:46.297302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-472b715c-3dc0-48a4-b78f-f0faa3185a57 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:46.298859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-472b715c-3dc0-48a4-b78f-f0faa3185a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:46.391881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 14/25] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:31:46.639562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9cec6-fcec-4529-929f-4637a8a4243c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.640276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9cec6-fcec-4529-929f-4637a8a4243c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.640788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9cec6-fcec-4529-929f-4637a8a4243c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.642402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 12/26] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:46.647871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e043fa-3891-4737-abc4-f40b480e45d0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.648196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e043fa-3891-4737-abc4-f40b480e45d0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.648462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e043fa-3891-4737-abc4-f40b480e45d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.673204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-18e043fa-3891-4737-abc4-f40b480e45d0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:46.674411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-18e043fa-3891-4737-abc4-f40b480e45d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:46.699003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9cec6-fcec-4529-929f-4637a8a4243c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:46.760765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:46.781177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 15/27] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:46.805715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d145-49f6-474e-a7d6-66b29bb97b74 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.806054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d145-49f6-474e-a7d6-66b29bb97b74 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.806346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67d145-49f6-474e-a7d6-66b29bb97b74 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.807768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 16/28] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:31:46.818678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9cec6-fcec-4529-929f-4637a8a4243c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:46.821798 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c979-ad06-43e6-801b-ffa53cc786a5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.822338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c979-ad06-43e6-801b-ffa53cc786a5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.822787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0680c979-ad06-43e6-801b-ffa53cc786a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.837028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:46.865913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:46.866566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:46.866851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:46.867123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:46.870820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0680c979-ad06-43e6-801b-ffa53cc786a5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:46.872013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0680c979-ad06-43e6-801b-ffa53cc786a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:46.885810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:46.887143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:31:46.912195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:46.913193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:31:46.914139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:31:46.914139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:31:46.914139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:31:46.914139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 13/29] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:31:46.914139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:47.023335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 17/30] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:31:47.028260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c979-ad06-43e6-801b-ffa53cc786a5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:47.123011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:47.134892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c4641-e725-4ae8-a6d9-eb7110701d9d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:47.211640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db2f80-efc9-42ef-b1e1-75db9d93c51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:47.213074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db2f80-efc9-42ef-b1e1-75db9d93c51c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:47.213575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db2f80-efc9-42ef-b1e1-75db9d93c51c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:47.214044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db2f80-efc9-42ef-b1e1-75db9d93c51c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:47.224916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0680c979-ad06-43e6-801b-ffa53cc786a5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:47.241697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db2f80-efc9-42ef-b1e1-75db9d93c51c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-20db2f80-efc9-42ef-b1e1-75db9d93c51c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:31:47.251030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:47.251860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:31:47.252639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:31:47.260154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 14/31] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:31:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:31:47.261237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db2f80-efc9-42ef-b1e1-75db9d93c51c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:47.304729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:47.305730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:47.306259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:47.306748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:47.307594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:47.308104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:47.310451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:47.313996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:47.340499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 18/32] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:47.346079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:47.434235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db2f80-efc9-42ef-b1e1-75db9d93c51c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:47.470956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd52197-c1fd-4dd3-a441-1a7f0b34a00a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:47.471120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d051f0-9032-4131-ad0c-8b94ba34d55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:47.471717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d051f0-9032-4131-ad0c-8b94ba34d55e None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:47.471999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d051f0-9032-4131-ad0c-8b94ba34d55e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:47.472315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d051f0-9032-4131-ad0c-8b94ba34d55e None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:47.473634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d051f0-9032-4131-ad0c-8b94ba34d55e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:47.475016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d051f0-9032-4131-ad0c-8b94ba34d55e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:47.508711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:47.509325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:47.509605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:47.509878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:47.510548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:47.510848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:47.512273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:47.525347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 19/33] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:31:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:47.525347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:47.587290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:47.614350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 15/34] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 31 09:31:47 2022] POST /identity/v3/roles => generated 225 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:31:47.618130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d051f0-9032-4131-ad0c-8b94ba34d55e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:47.641075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e5bb9-c885-4f9f-98c6-462820934dd7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:47.646684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:47.686736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b496e3-dfba-498f-8f4d-3239b954e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:47.687725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b496e3-dfba-498f-8f4d-3239b954e4f0 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:47.688263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b496e3-dfba-498f-8f4d-3239b954e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:47.688788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b496e3-dfba-498f-8f4d-3239b954e4f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:47.689676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b496e3-dfba-498f-8f4d-3239b954e4f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:47.692646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b496e3-dfba-498f-8f4d-3239b954e4f0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:47.759982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d051f0-9032-4131-ad0c-8b94ba34d55e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:47.801686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53266487-b079-41e9-a2d3-10971ed3304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:47.802357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266487-b079-41e9-a2d3-10971ed3304b None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:47.802649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266487-b079-41e9-a2d3-10971ed3304b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:47.802927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53266487-b079-41e9-a2d3-10971ed3304b None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:47.803623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266487-b079-41e9-a2d3-10971ed3304b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:47.805186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53266487-b079-41e9-a2d3-10971ed3304b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:47.822224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 16/35] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 31 09:31:47 2022] POST /identity/v3/roles => generated 219 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:31:47.823355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747b07-82b6-4175-a521-ac1935312312 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:47.823645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747b07-82b6-4175-a521-ac1935312312 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:47.823921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85747b07-82b6-4175-a521-ac1935312312 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:47.825347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 17/36] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:47.830428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747b07-82b6-4175-a521-ac1935312312 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:47.866857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 20/37] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:31:47 2022] POST /identity/v3/projects => generated 301 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:31:47.869168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6492-3140-4b97-beff-779fa0717441 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:47.869917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6492-3140-4b97-beff-779fa0717441 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:47.870260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce6492-3140-4b97-beff-779fa0717441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:47.958919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:47.976368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85747b07-82b6-4175-a521-ac1935312312 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:48.010297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-77ce6492-3140-4b97-beff-779fa0717441 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:48.011928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-77ce6492-3140-4b97-beff-779fa0717441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:48.027448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158a4d02-89b5-4dc2-b7dc-80ced3a5dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:48.028101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a4d02-89b5-4dc2-b7dc-80ced3a5dc86 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:48.028519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a4d02-89b5-4dc2-b7dc-80ced3a5dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:48.028696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158a4d02-89b5-4dc2-b7dc-80ced3a5dc86 None admin] PATH_INFO: `/v3/users/07cf079d1e524f8aa193b1bfe9096586` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:48.030281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a4d02-89b5-4dc2-b7dc-80ced3a5dc86 None admin] RBAC: Authorizing `identity:get_user(user_id=07cf079d1e524f8aa193b1bfe9096586)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:48.031762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158a4d02-89b5-4dc2-b7dc-80ced3a5dc86 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:48.033547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 18/38] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:31:47 2022] GET /identity/v3/users/07cf079d1e524f8aa193b1bfe9096586 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:48.035192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760555-cae1-4dfd-9adb-2eab2a4f74be None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:48.035471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760555-cae1-4dfd-9adb-2eab2a4f74be None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:48.036204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6760555-cae1-4dfd-9adb-2eab2a4f74be None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:48.037887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 19/39] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:48.039405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6760555-cae1-4dfd-9adb-2eab2a4f74be None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:48.107652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 21/40] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:48.109453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260bb01-5ced-4bf9-8d05-639c5f020391 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:48.109749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260bb01-5ced-4bf9-8d05-639c5f020391 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:48.110014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260bb01-5ced-4bf9-8d05-639c5f020391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:48.129266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3260bb01-5ced-4bf9-8d05-639c5f020391 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:48.130452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3260bb01-5ced-4bf9-8d05-639c5f020391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:48.168446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:48.185109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6760555-cae1-4dfd-9adb-2eab2a4f74be None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:48.212624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 22/41] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:48.224337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90c32-fe42-4628-a9d1-6e6a9ee40b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:48.224337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90c32-fe42-4628-a9d1-6e6a9ee40b0d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:48.224337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90c32-fe42-4628-a9d1-6e6a9ee40b0d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:48.224337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f90c32-fe42-4628-a9d1-6e6a9ee40b0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:48.224962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f90c32-fe42-4628-a9d1-6e6a9ee40b0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:48.226247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f90c32-fe42-4628-a9d1-6e6a9ee40b0d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:48.227987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 20/42] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:48.233496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260bb01-5ced-4bf9-8d05-639c5f020391 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:48.337070 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3260bb01-5ced-4bf9-8d05-639c5f020391 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:48.372102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bd8a3-a1b7-41da-a71f-5ccace0736c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:48.372790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd8a3-a1b7-41da-a71f-5ccace0736c4 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:48.373091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd8a3-a1b7-41da-a71f-5ccace0736c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:48.373364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bd8a3-a1b7-41da-a71f-5ccace0736c4 None admin] PATH_INFO: `/v3/domains/default/users/07cf079d1e524f8aa193b1bfe9096586/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:48.375309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bd8a3-a1b7-41da-a71f-5ccace0736c4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=07cf079d1e524f8aa193b1bfe9096586, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:48.377365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bd8a3-a1b7-41da-a71f-5ccace0736c4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:48.377749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90c32-fe42-4628-a9d1-6e6a9ee40b0d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:48.394590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 23/43] 10.222.0.18 () {58 vars in 1361 bytes} [Wed Aug 31 09:31:48 2022] PUT /identity/v3/domains/default/users/07cf079d1e524f8aa193b1bfe9096586/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:31:48.395245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:48.482143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bd8a3-a1b7-41da-a71f-5ccace0736c4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:48.494013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f90c32-fe42-4628-a9d1-6e6a9ee40b0d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:48.520671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:48.537740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8614d3-e5a4-4dbb-a796-0417a7cbe437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:48.538360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8614d3-e5a4-4dbb-a796-0417a7cbe437 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:48.539016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8614d3-e5a4-4dbb-a796-0417a7cbe437 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:48.539016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8614d3-e5a4-4dbb-a796-0417a7cbe437 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:48.539590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8614d3-e5a4-4dbb-a796-0417a7cbe437 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:48.541018 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8614d3-e5a4-4dbb-a796-0417a7cbe437 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:48.557596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 21/44] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 31 09:31:48 2022] POST /identity/v3/roles => generated 223 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:31:48.616099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bd8a3-a1b7-41da-a71f-5ccace0736c4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:48.653662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce09aafd-2d7d-4904-8989-5c08257f5d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:48.654309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09aafd-2d7d-4904-8989-5c08257f5d5c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:48.654594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09aafd-2d7d-4904-8989-5c08257f5d5c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:48.654866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce09aafd-2d7d-4904-8989-5c08257f5d5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:48.656005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09aafd-2d7d-4904-8989-5c08257f5d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:48.657538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce09aafd-2d7d-4904-8989-5c08257f5d5c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:48.659857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 24/45] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:48.665608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8614d3-e5a4-4dbb-a796-0417a7cbe437 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:48.754163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:48.780564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8614d3-e5a4-4dbb-a796-0417a7cbe437 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:48.813943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fe47c-e68e-4661-88fa-c1bcd78b8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:48.814607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe47c-e68e-4661-88fa-c1bcd78b8bd0 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:48.814934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe47c-e68e-4661-88fa-c1bcd78b8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:48.815215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fe47c-e68e-4661-88fa-c1bcd78b8bd0 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:48.815879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fe47c-e68e-4661-88fa-c1bcd78b8bd0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:48.817370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fe47c-e68e-4661-88fa-c1bcd78b8bd0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:48.845723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 22/46] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:31:48 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:31:50.292566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6576-4497-48e3-ab86-27949366716d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:50.293106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6576-4497-48e3-ab86-27949366716d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:50.293106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a6576-4497-48e3-ab86-27949366716d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:50.294641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 25/47] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:50.300259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9f05-0ba2-4989-9a8a-d6c6ad6bf8f1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:50.300697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9f05-0ba2-4989-9a8a-d6c6ad6bf8f1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:50.300895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f9f05-0ba2-4989-9a8a-d6c6ad6bf8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:50.319878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f70f9f05-0ba2-4989-9a8a-d6c6ad6bf8f1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:50.321391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f70f9f05-0ba2-4989-9a8a-d6c6ad6bf8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:50.386725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 23/48] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:50.651626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a6576-4497-48e3-ab86-27949366716d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:50.748624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:50.756576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a6576-4497-48e3-ab86-27949366716d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:50.774986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efbe64-9cdc-4ecc-8607-13328ce77f68 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:50.775355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efbe64-9cdc-4ecc-8607-13328ce77f68 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:50.775699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1efbe64-9cdc-4ecc-8607-13328ce77f68 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:50.777148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 24/49] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:31:50.781899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17feae-ff30-49b8-87c2-a624594938b7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:50.782221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17feae-ff30-49b8-87c2-a624594938b7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:50.782498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17feae-ff30-49b8-87c2-a624594938b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:50.792429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d89b3-440e-41ff-940d-7a3b0bed2e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:50.793058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d89b3-440e-41ff-940d-7a3b0bed2e55 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:50.793344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d89b3-440e-41ff-940d-7a3b0bed2e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:50.793620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d89b3-440e-41ff-940d-7a3b0bed2e55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:50.800115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0a17feae-ff30-49b8-87c2-a624594938b7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:50.801369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0a17feae-ff30-49b8-87c2-a624594938b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:50.804208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d89b3-440e-41ff-940d-7a3b0bed2e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ee1d89b3-440e-41ff-940d-7a3b0bed2e55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:31:50.809141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:50.810054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:31:50.810805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 26/50] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:31:50.816749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d89b3-440e-41ff-940d-7a3b0bed2e55 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:50.852722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:50.870466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 25/51] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:31:50.915593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d89b3-440e-41ff-940d-7a3b0bed2e55 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:50.950733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:50.951518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:50.951686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:50.951938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:50.952840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:50.953324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:50.954749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:50.963432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 27/52] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:50.970663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17feae-ff30-49b8-87c2-a624594938b7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:51.068240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17feae-ff30-49b8-87c2-a624594938b7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:51.101367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fd02f-7a02-4ab8-941d-a0b9679163ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:51.101993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd02f-7a02-4ab8-941d-a0b9679163ae None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:51.102279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd02f-7a02-4ab8-941d-a0b9679163ae None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:51.102551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fd02f-7a02-4ab8-941d-a0b9679163ae None admin] PATH_INFO: `/v3/users/07cf079d1e524f8aa193b1bfe9096586` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:51.103653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fd02f-7a02-4ab8-941d-a0b9679163ae None admin] RBAC: Authorizing `identity:get_user(user_id=07cf079d1e524f8aa193b1bfe9096586)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:51.105126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fd02f-7a02-4ab8-941d-a0b9679163ae None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:51.106688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 26/53] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:31:50 2022] GET /identity/v3/users/07cf079d1e524f8aa193b1bfe9096586 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:51.112810 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:51.132112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:51.144570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fd02f-7a02-4ab8-941d-a0b9679163ae None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:51.214765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2e976-4307-45ac-90a4-c20029d0e232 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:51.253604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4cc2-b5d0-4133-a5d9-a7ce1fe7760e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:51.254524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4cc2-b5d0-4133-a5d9-a7ce1fe7760e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:51.254944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4cc2-b5d0-4133-a5d9-a7ce1fe7760e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:51.255337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d4cc2-b5d0-4133-a5d9-a7ce1fe7760e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:51.256565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d4cc2-b5d0-4133-a5d9-a7ce1fe7760e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:51.258080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d4cc2-b5d0-4133-a5d9-a7ce1fe7760e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:51.259733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 28/54] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:51.266391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4cc2-b5d0-4133-a5d9-a7ce1fe7760e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:51.305398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:51.350382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fd02f-7a02-4ab8-941d-a0b9679163ae None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:51.361228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:51.377537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d4cc2-b5d0-4133-a5d9-a7ce1fe7760e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:51.383854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda210-b278-407b-939d-738cb347393f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:51.384524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda210-b278-407b-939d-738cb347393f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:51.384804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda210-b278-407b-939d-738cb347393f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:51.385074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda210-b278-407b-939d-738cb347393f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:51.386168 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda210-b278-407b-939d-738cb347393f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:51.387613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eda210-b278-407b-939d-738cb347393f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:51.389198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:51.395204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda210-b278-407b-939d-738cb347393f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:51.411099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aba66d-9f06-4c6e-9e92-bcc59308c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:51.411711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba66d-9f06-4c6e-9e92-bcc59308c57b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:51.411999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba66d-9f06-4c6e-9e92-bcc59308c57b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:51.412315 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba66d-9f06-4c6e-9e92-bcc59308c57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:51.413047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aba66d-9f06-4c6e-9e92-bcc59308c57b None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.domain.id=default, user.id=07cf079d1e524f8aa193b1bfe9096586) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:51.413362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aba66d-9f06-4c6e-9e92-bcc59308c57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:51.414864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aba66d-9f06-4c6e-9e92-bcc59308c57b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:51.420767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1322 bytes} [Wed Aug 31 09:31:51 2022] GET /identity/v3/role_assignments?user.id=07cf079d1e524f8aa193b1bfe9096586&scope.domain.id=default&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:31:51.497770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eda210-b278-407b-939d-738cb347393f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:51.521898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:51.534531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff3cf-f143-490a-9d5f-e4aa14ff1e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:51.535161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff3cf-f143-490a-9d5f-e4aa14ff1e04 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:51.535448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff3cf-f143-490a-9d5f-e4aa14ff1e04 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:51.535726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff3cf-f143-490a-9d5f-e4aa14ff1e04 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:51.536435 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeff3cf-f143-490a-9d5f-e4aa14ff1e04 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:51.537904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeff3cf-f143-490a-9d5f-e4aa14ff1e04 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:51.567571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Aug 31 09:31:51 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:31:53.456987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7dedd-0f77-4d13-aa69-78f7567c9607 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:53.457531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7dedd-0f77-4d13-aa69-78f7567c9607 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:53.457531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7dedd-0f77-4d13-aa69-78f7567c9607 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:53.458868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:53.463829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff30cc-1a3d-4841-bf38-332f93188e0d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:53.464254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff30cc-1a3d-4841-bf38-332f93188e0d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:53.464403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff30cc-1a3d-4841-bf38-332f93188e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:53.483183 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ebff30cc-1a3d-4841-bf38-332f93188e0d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:53.484394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ebff30cc-1a3d-4841-bf38-332f93188e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:53.548573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:53.815895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7dedd-0f77-4d13-aa69-78f7567c9607 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:53.915048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7dedd-0f77-4d13-aa69-78f7567c9607 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:53.948360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e159ab-8b5a-4c6a-8e35-059a3c8641a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:53.949704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e159ab-8b5a-4c6a-8e35-059a3c8641a5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:53.950041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e159ab-8b5a-4c6a-8e35-059a3c8641a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:53.950318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e159ab-8b5a-4c6a-8e35-059a3c8641a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:53.951472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e159ab-8b5a-4c6a-8e35-059a3c8641a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:53.952975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e159ab-8b5a-4c6a-8e35-059a3c8641a5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:53.954577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:53.960143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff30cc-1a3d-4841-bf38-332f93188e0d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:54.056478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff30cc-1a3d-4841-bf38-332f93188e0d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:54.059488 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:54.090238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed3611-a6ef-4190-a427-cea25bb1a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:54.090830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed3611-a6ef-4190-a427-cea25bb1a715 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:54.091111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed3611-a6ef-4190-a427-cea25bb1a715 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:54.091382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed3611-a6ef-4190-a427-cea25bb1a715 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:54.092039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed3611-a6ef-4190-a427-cea25bb1a715 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:54.093510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed3611-a6ef-4190-a427-cea25bb1a715 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:54.119074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:31:53 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:31:57.253689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd56e-ab49-4c1c-b946-007d9fbdafa0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.254191 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd56e-ab49-4c1c-b946-007d9fbdafa0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.254262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bdd56e-ab49-4c1c-b946-007d9fbdafa0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.255581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:57.261354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b76af-cb80-4307-a729-bb76d866bd4d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.262459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b76af-cb80-4307-a729-bb76d866bd4d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.262938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b76af-cb80-4307-a729-bb76d866bd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.293651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-135b76af-cb80-4307-a729-bb76d866bd4d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:57.295176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-135b76af-cb80-4307-a729-bb76d866bd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:57.389362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d3ae-7a90-4786-897a-643d304ae8e0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.390010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d3ae-7a90-4786-897a-643d304ae8e0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.390485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d3ae-7a90-4786-897a-643d304ae8e0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.392030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 33/63] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:31:57.394363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 31/64] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:57.400374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0137065-1551-48ab-ba7c-d16b26b0acf1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.400942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0137065-1551-48ab-ba7c-d16b26b0acf1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.401421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0137065-1551-48ab-ba7c-d16b26b0acf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.428814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-d0137065-1551-48ab-ba7c-d16b26b0acf1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:57.430046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d0137065-1551-48ab-ba7c-d16b26b0acf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:57.448725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:57.526023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 34/65] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:57.550979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac9bb-bafd-4d44-9a2f-bfbffea8a994 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.551577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac9bb-bafd-4d44-9a2f-bfbffea8a994 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.552058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ac9bb-bafd-4d44-9a2f-bfbffea8a994 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.553897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 32/66] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:57.558676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691e96-b332-4321-8ca2-9d86051daf28 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.558967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691e96-b332-4321-8ca2-9d86051daf28 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.559246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691e96-b332-4321-8ca2-9d86051daf28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.580927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-34691e96-b332-4321-8ca2-9d86051daf28 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:57.582119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-34691e96-b332-4321-8ca2-9d86051daf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:57.588762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c1007-bbd5-4d03-9a54-efdd7d414af4 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.589347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c1007-bbd5-4d03-9a54-efdd7d414af4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.589979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c1007-bbd5-4d03-9a54-efdd7d414af4 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.591723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 33/67] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:57.597120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0333f7e-7ebf-45bf-a714-7f05c85073ab None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.597643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0333f7e-7ebf-45bf-a714-7f05c85073ab None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.598137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0333f7e-7ebf-45bf-a714-7f05c85073ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.635548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b0333f7e-7ebf-45bf-a714-7f05c85073ab None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:57.637105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b0333f7e-7ebf-45bf-a714-7f05c85073ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:57.687349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 35/68] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:57.737778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 34/69] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:57.796043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34691e96-b332-4321-8ca2-9d86051daf28 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:57.901667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:57.926931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34691e96-b332-4321-8ca2-9d86051daf28 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:57.968770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0333f7e-7ebf-45bf-a714-7f05c85073ab None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:57.990836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0577e7-ee57-411b-a124-934472dabf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:57.991600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0577e7-ee57-411b-a124-934472dabf8a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:57.991884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0577e7-ee57-411b-a124-934472dabf8a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:57.992159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0577e7-ee57-411b-a124-934472dabf8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:57.997948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.006980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0577e7-ee57-411b-a124-934472dabf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-7d0577e7-ee57-411b-a124-934472dabf8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:31:58.012512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:58.013406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:31:58.014163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 36/70] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:31:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:31:58.014782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0577e7-ee57-411b-a124-934472dabf8a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.086738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0333f7e-7ebf-45bf-a714-7f05c85073ab None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.117673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0577e7-ee57-411b-a124-934472dabf8a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.121151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b59cb-45ab-423f-b8cb-2d855e659b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.121769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b59cb-45ab-423f-b8cb-2d855e659b34 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.122053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b59cb-45ab-423f-b8cb-2d855e659b34 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.122327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b59cb-45ab-423f-b8cb-2d855e659b34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.132459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b59cb-45ab-423f-b8cb-2d855e659b34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-297b59cb-45ab-423f-b8cb-2d855e659b34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:31:58.137380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:58.138427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:31:58.139242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 35/71] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:31:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:31:58.140444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d36fd-5553-4436-b65b-52aec424f847 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.140444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d36fd-5553-4436-b65b-52aec424f847 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.140686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d36fd-5553-4436-b65b-52aec424f847 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.141994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 36/72] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:31:58.142710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d36fd-5553-4436-b65b-52aec424f847 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.155949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dcfea-23d5-4819-8b53-1c291a4a86b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.156684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dcfea-23d5-4819-8b53-1c291a4a86b5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.156966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dcfea-23d5-4819-8b53-1c291a4a86b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.157239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5dcfea-23d5-4819-8b53-1c291a4a86b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.165082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.169504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5dcfea-23d5-4819-8b53-1c291a4a86b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1a5dcfea-23d5-4819-8b53-1c291a4a86b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:31:58.174617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:58.175564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:31:58.176338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 37/73] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:31:58.177497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dcfea-23d5-4819-8b53-1c291a4a86b5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.229055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.250488 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d36fd-5553-4436-b65b-52aec424f847 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.277118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5dcfea-23d5-4819-8b53-1c291a4a86b5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.284061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.284699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.284986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.285262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.285929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:58.286233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:58.287633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:58.299414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 37/74] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:58.300238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.316115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86864b65-4606-4d40-b51c-339a93b4d286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.316842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86864b65-4606-4d40-b51c-339a93b4d286 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.317128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86864b65-4606-4d40-b51c-339a93b4d286 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.317406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86864b65-4606-4d40-b51c-339a93b4d286 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.327423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86864b65-4606-4d40-b51c-339a93b4d286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-86864b65-4606-4d40-b51c-339a93b4d286 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:31:58.332438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:31:58.333306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:31:58.334054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 38/75] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:31:58.335332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff72f4-dac9-4922-a761-154d6b2ebaf7 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.336040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff72f4-dac9-4922-a761-154d6b2ebaf7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.336040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff72f4-dac9-4922-a761-154d6b2ebaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.353061 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ecff72f4-dac9-4922-a761-154d6b2ebaf7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:31:58.354256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ecff72f4-dac9-4922-a761-154d6b2ebaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:31:58.400230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a79095-5ced-4c51-a1cc-cb8794d2de3d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.406871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.421297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 39/76] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:31:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:31:58.422123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff72f4-dac9-4922-a761-154d6b2ebaf7 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.441953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.442572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.443160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.443283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.444458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:58.444765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:58.446436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:58.455372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 38/77] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:58.457351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.462723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.528211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff72f4-dac9-4922-a761-154d6b2ebaf7 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.567114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143af96b-e7fc-457b-9279-db45628ed8a4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.568048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.569463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.569748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.570058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.571533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:58.571841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:58.573281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:58.589716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 40/78] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:58.591065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.620527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87087-60a0-4303-9511-092fe67dcaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.621219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87087-60a0-4303-9511-092fe67dcaed None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.621577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87087-60a0-4303-9511-092fe67dcaed None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.621935 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac87087-60a0-4303-9511-092fe67dcaed None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.638684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac87087-60a0-4303-9511-092fe67dcaed None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:58.640214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac87087-60a0-4303-9511-092fe67dcaed None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:58.646343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 39/79] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:58.646343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87087-60a0-4303-9511-092fe67dcaed None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.647994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.719704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.720621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c95cb-ce1b-4252-9349-b1bba33e6df0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.755703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.756433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.756716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.756979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.757639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:31:58.757945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:58.759332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:58.765205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac87087-60a0-4303-9511-092fe67dcaed None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.767293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 41/80] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:58.768130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.801744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c25a5-c4ad-4ab3-8e1a-d4b972582556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.802457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c25a5-c4ad-4ab3-8e1a-d4b972582556 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.802767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c25a5-c4ad-4ab3-8e1a-d4b972582556 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.803231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c25a5-c4ad-4ab3-8e1a-d4b972582556 None admin] PATH_INFO: `/v3/users/07cf079d1e524f8aa193b1bfe9096586` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.804400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c25a5-c4ad-4ab3-8e1a-d4b972582556 None admin] RBAC: Authorizing `identity:get_user(user_id=07cf079d1e524f8aa193b1bfe9096586)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:58.805828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c25a5-c4ad-4ab3-8e1a-d4b972582556 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:58.807397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 40/81] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/users/07cf079d1e524f8aa193b1bfe9096586 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:58.808147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c25a5-c4ad-4ab3-8e1a-d4b972582556 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.870148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da9887-49f0-480d-8e3f-30ab4aeb3663 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.882625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.903802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b33ec9-6235-4ae4-b79d-d543835d39ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.904475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b33ec9-6235-4ae4-b79d-d543835d39ce None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.904760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b33ec9-6235-4ae4-b79d-d543835d39ce None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.905042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b33ec9-6235-4ae4-b79d-d543835d39ce None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:58.905786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c25a5-c4ad-4ab3-8e1a-d4b972582556 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:58.906179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b33ec9-6235-4ae4-b79d-d543835d39ce None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:58.907651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b33ec9-6235-4ae4-b79d-d543835d39ce None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:58.909266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 42/82] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:58.910033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b33ec9-6235-4ae4-b79d-d543835d39ce None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:58.934238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:58.940615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c01413-8362-4971-8935-d375c3fcc5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:58.941313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c01413-8362-4971-8935-d375c3fcc5b7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:58.941597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c01413-8362-4971-8935-d375c3fcc5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:58.941869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c01413-8362-4971-8935-d375c3fcc5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.008027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b33ec9-6235-4ae4-b79d-d543835d39ce None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:59.008439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c01413-8362-4971-8935-d375c3fcc5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.009947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c01413-8362-4971-8935-d375c3fcc5b7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.043645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8ef7-2e58-4e83-bafe-1a9e69b6ae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:59.044291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8ef7-2e58-4e83-bafe-1a9e69b6ae6d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:59.044578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8ef7-2e58-4e83-bafe-1a9e69b6ae6d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:59.044853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed8ef7-2e58-4e83-bafe-1a9e69b6ae6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.045979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed8ef7-2e58-4e83-bafe-1a9e69b6ae6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.047448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed8ef7-2e58-4e83-bafe-1a9e69b6ae6d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.049033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 43/83] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:59.053126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8ef7-2e58-4e83-bafe-1a9e69b6ae6d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.102273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:59.107510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 41/84] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:31:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:31:59.108458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c01413-8362-4971-8935-d375c3fcc5b7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.137680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:59.156330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed8ef7-2e58-4e83-bafe-1a9e69b6ae6d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:59.189246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71755bd-f4e6-4d61-83be-edd2cd3eaffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:59.189905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71755bd-f4e6-4d61-83be-edd2cd3eaffc None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:59.190193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71755bd-f4e6-4d61-83be-edd2cd3eaffc None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:59.190527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71755bd-f4e6-4d61-83be-edd2cd3eaffc None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.191694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71755bd-f4e6-4d61-83be-edd2cd3eaffc None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.193836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71755bd-f4e6-4d61-83be-edd2cd3eaffc None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.195420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 44/85] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:31:59 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:59.196243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71755bd-f4e6-4d61-83be-edd2cd3eaffc None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.207119 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c01413-8362-4971-8935-d375c3fcc5b7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:59.241448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30851bc0-9ff0-461b-838c-cd6864125a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:59.242048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30851bc0-9ff0-461b-838c-cd6864125a46 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:59.242330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30851bc0-9ff0-461b-838c-cd6864125a46 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:59.242679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30851bc0-9ff0-461b-838c-cd6864125a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.297330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71755bd-f4e6-4d61-83be-edd2cd3eaffc None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:59.310070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30851bc0-9ff0-461b-838c-cd6864125a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.311624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30851bc0-9ff0-461b-838c-cd6864125a46 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.313869 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:59.334066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2cf8e-f9ce-40c2-80cc-edc8344658a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:59.334748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cf8e-f9ce-40c2-80cc-edc8344658a4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:59.335036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cf8e-f9ce-40c2-80cc-edc8344658a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:59.335316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2cf8e-f9ce-40c2-80cc-edc8344658a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.342282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:59.402371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2cf8e-f9ce-40c2-80cc-edc8344658a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.403775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2cf8e-f9ce-40c2-80cc-edc8344658a4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.412214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 42/86] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:31:59.413110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30851bc0-9ff0-461b-838c-cd6864125a46 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.504465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 45/87] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:31:59.505342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2cf8e-f9ce-40c2-80cc-edc8344658a4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.508402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30851bc0-9ff0-461b-838c-cd6864125a46 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:59.522944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:59.537682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:59.543368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b65bfb-00f7-43dd-9776-f092c5b3fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:59.543986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65bfb-00f7-43dd-9776-f092c5b3fef7 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:59.544304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65bfb-00f7-43dd-9776-f092c5b3fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:59.544583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b65bfb-00f7-43dd-9776-f092c5b3fef7 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.545238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b65bfb-00f7-43dd-9776-f092c5b3fef7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.546693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b65bfb-00f7-43dd-9776-f092c5b3fef7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.567342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 43/88] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:31:59 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:31:59.568588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b65bfb-00f7-43dd-9776-f092c5b3fef7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.622517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2cf8e-f9ce-40c2-80cc-edc8344658a4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:59.660916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34839372-9d05-4596-8ae1-d5d3a7eac917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:59.661588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34839372-9d05-4596-8ae1-d5d3a7eac917 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:59.661882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34839372-9d05-4596-8ae1-d5d3a7eac917 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:59.665180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34839372-9d05-4596-8ae1-d5d3a7eac917 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.665180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34839372-9d05-4596-8ae1-d5d3a7eac917 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.665180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34839372-9d05-4596-8ae1-d5d3a7eac917 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.671571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 46/89] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:31:59 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:59.671571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34839372-9d05-4596-8ae1-d5d3a7eac917 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.694793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b65bfb-00f7-43dd-9776-f092c5b3fef7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:59.737870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca10f0-d139-4962-9b80-6ab33cd73c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:59.738733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca10f0-d139-4962-9b80-6ab33cd73c4d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:59.739020 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca10f0-d139-4962-9b80-6ab33cd73c4d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:59.739801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca10f0-d139-4962-9b80-6ab33cd73c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.772806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:59.789229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34839372-9d05-4596-8ae1-d5d3a7eac917 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:31:59.811335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:31:59.829955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4a4bc-e8ae-407f-894d-d714d59b2652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:31:59.830285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4a4bc-e8ae-407f-894d-d714d59b2652 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:31:59.830573 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4a4bc-e8ae-407f-894d-d714d59b2652 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:31:59.830848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4a4bc-e8ae-407f-894d-d714d59b2652 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:31:59.832411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4a4bc-e8ae-407f-894d-d714d59b2652 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.834259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4a4bc-e8ae-407f-894d-d714d59b2652 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.835450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca10f0-d139-4962-9b80-6ab33cd73c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:31:59.836280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 47/90] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:31:59 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:31:59.837079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4a4bc-e8ae-407f-894d-d714d59b2652 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.837721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca10f0-d139-4962-9b80-6ab33cd73c4d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:31:59.966866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 44/91] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:31:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:31:59.968184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca10f0-d139-4962-9b80-6ab33cd73c4d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:31:59.974057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4a4bc-e8ae-407f-894d-d714d59b2652 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:00.022473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291d2c-aa7c-434c-9a4e-0f7b47a8a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:00.024097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291d2c-aa7c-434c-9a4e-0f7b47a8a18f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:00.024652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291d2c-aa7c-434c-9a4e-0f7b47a8a18f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:00.025134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6291d2c-aa7c-434c-9a4e-0f7b47a8a18f None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:00.027021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6291d2c-aa7c-434c-9a4e-0f7b47a8a18f None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:00.029229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6291d2c-aa7c-434c-9a4e-0f7b47a8a18f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:00.031208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 48/92] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:31:59 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:00.036925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291d2c-aa7c-434c-9a4e-0f7b47a8a18f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:00.062959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:00.081599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:00.111019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca10f0-d139-4962-9b80-6ab33cd73c4d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:00.154517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6291d2c-aa7c-434c-9a4e-0f7b47a8a18f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:00.159050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:00.159834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:00.160280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:00.160754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:00.161625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] RBAC: Adding query filter params (role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=03aab93361d540d59cc78163f7da6239, user.id=ece3258dc3b7408eb33f44129658af4e) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:00.162073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:00.164210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:00.184357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 45/93] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:31:59 2022] GET /identity/v3/role_assignments?user.id=ece3258dc3b7408eb33f44129658af4e&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:00.184357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:00.218985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:00.219567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:00.219853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:00.220196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:00.220984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=03aab93361d540d59cc78163f7da6239, user.id=07cf079d1e524f8aa193b1bfe9096586) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:00.221337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:00.222890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:00.239698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 49/94] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:00 2022] GET /identity/v3/role_assignments?user.id=07cf079d1e524f8aa193b1bfe9096586&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:00.240525 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:00.316086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c33d4b-1607-42b2-98c5-57bb2c723405 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:00.365210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3055e-0287-4cba-820b-334cadf76fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:00.366308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3055e-0287-4cba-820b-334cadf76fab None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:00.366805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3055e-0287-4cba-820b-334cadf76fab None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:00.367284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3055e-0287-4cba-820b-334cadf76fab None admin] PATH_INFO: `/v3/projects/b58e35fc963e4981b21637950848c090` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:00.368739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3055e-0287-4cba-820b-334cadf76fab None admin] RBAC: Authorizing `identity:get_project(project_id=b58e35fc963e4981b21637950848c090)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:00.370566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3055e-0287-4cba-820b-334cadf76fab None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:00.372640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 46/95] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:00 2022] GET /identity/v3/projects/b58e35fc963e4981b21637950848c090 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:00.379096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3055e-0287-4cba-820b-334cadf76fab None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:00.383574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:00.404603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:00.410030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7443e-f8ac-43c0-b4b0-da2077738af4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:00.475458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da98e6f-2637-460f-b07a-bec60d88870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:00.476019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da98e6f-2637-460f-b07a-bec60d88870b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:00.476353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da98e6f-2637-460f-b07a-bec60d88870b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:00.476640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da98e6f-2637-460f-b07a-bec60d88870b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:00.477683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da98e6f-2637-460f-b07a-bec60d88870b None admin] RBAC: Adding query filter params (role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=03aab93361d540d59cc78163f7da6239, user.id=ece3258dc3b7408eb33f44129658af4e) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:00.477683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da98e6f-2637-460f-b07a-bec60d88870b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:00.479167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da98e6f-2637-460f-b07a-bec60d88870b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:00.490820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 50/96] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:00 2022] GET /identity/v3/role_assignments?user.id=ece3258dc3b7408eb33f44129658af4e&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:00.499267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3055e-0287-4cba-820b-334cadf76fab None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:00.538142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97426a-c3c1-4083-91b4-780ff3f5aaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:00.539117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97426a-c3c1-4083-91b4-780ff3f5aaf3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:00.539612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97426a-c3c1-4083-91b4-780ff3f5aaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:00.540072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97426a-c3c1-4083-91b4-780ff3f5aaf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:00.541075 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97426a-c3c1-4083-91b4-780ff3f5aaf3 None admin] RBAC: Adding query filter params (role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=b58e35fc963e4981b21637950848c090, user.id=ece3258dc3b7408eb33f44129658af4e) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:00.541579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97426a-c3c1-4083-91b4-780ff3f5aaf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:00.543272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97426a-c3c1-4083-91b4-780ff3f5aaf3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:00.550031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 47/97] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:00 2022] GET /identity/v3/role_assignments?user.id=ece3258dc3b7408eb33f44129658af4e&scope.project.id=b58e35fc963e4981b21637950848c090&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:02.111046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d0b73-31c3-4736-a451-ae195e267672 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:02.111541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d0b73-31c3-4736-a451-ae195e267672 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:02.111614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d0b73-31c3-4736-a451-ae195e267672 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:02.113199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 51/98] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:02.129045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22da22-5bdd-40b1-bbe7-0e19541c7965 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:02.129926 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22da22-5bdd-40b1-bbe7-0e19541c7965 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:02.130394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22da22-5bdd-40b1-bbe7-0e19541c7965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:02.152931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dd337-db6b-446a-9e51-7b75d1ef6bc3 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:02.153220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dd337-db6b-446a-9e51-7b75d1ef6bc3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:02.153506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9dd337-db6b-446a-9e51-7b75d1ef6bc3 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:02.155066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-fc22da22-5bdd-40b1-bbe7-0e19541c7965 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:02.155490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 52/99] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:02.156835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fc22da22-5bdd-40b1-bbe7-0e19541c7965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:02.160713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d755f-235a-4053-9478-688357aae602 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:02.161011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d755f-235a-4053-9478-688357aae602 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:02.161335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d755f-235a-4053-9478-688357aae602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:02.180346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-479d755f-235a-4053-9478-688357aae602 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:02.181599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-479d755f-235a-4053-9478-688357aae602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:02.256706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 48/100] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:02.260297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 53/101] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:02.801136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22da22-5bdd-40b1-bbe7-0e19541c7965 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:02.817695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:02.834473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d755f-235a-4053-9478-688357aae602 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:02.984622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:02.989113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22da22-5bdd-40b1-bbe7-0e19541c7965 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:03.022617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d755f-235a-4053-9478-688357aae602 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:03.039309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aa9920-67a1-45c9-8466-5a9db67f192f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:03.039963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9920-67a1-45c9-8466-5a9db67f192f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.040270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9920-67a1-45c9-8466-5a9db67f192f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.040549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aa9920-67a1-45c9-8466-5a9db67f192f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.070184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aa9920-67a1-45c9-8466-5a9db67f192f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-84aa9920-67a1-45c9-8466-5a9db67f192f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:03.075207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:03.076110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:03.076875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:03.090174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 49/102] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:03.101862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c47e-463e-4f87-89c5-683d632e2d62 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.102153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c47e-463e-4f87-89c5-683d632e2d62 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.102421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d520c47e-463e-4f87-89c5-683d632e2d62 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.103767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 50/103] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:03.104495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c47e-463e-4f87-89c5-683d632e2d62 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:03.105633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5fe27-cd37-4325-814c-bd8a95256e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:03.106280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5fe27-cd37-4325-814c-bd8a95256e33 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.106558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5fe27-cd37-4325-814c-bd8a95256e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.106830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5fe27-cd37-4325-814c-bd8a95256e33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.108411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5fe27-cd37-4325-814c-bd8a95256e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:03.112713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5fe27-cd37-4325-814c-bd8a95256e33 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:03.114522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 54/104] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:03.115489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5afd-555a-4cb4-9fca-34a14d9e7fa1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.115776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5afd-555a-4cb4-9fca-34a14d9e7fa1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.116057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e5afd-555a-4cb4-9fca-34a14d9e7fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.151662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6a6e5afd-555a-4cb4-9fca-34a14d9e7fa1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:03.152902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6a6e5afd-555a-4cb4-9fca-34a14d9e7fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:03.224413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 55/105] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:03.225256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e5afd-555a-4cb4-9fca-34a14d9e7fa1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:03.256520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d520c47e-463e-4f87-89c5-683d632e2d62 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:03.259994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:03.295479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e1cab-e773-4cb3-a6ea-e2c8af2c87bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:03.296464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1cab-e773-4cb3-a6ea-e2c8af2c87bb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.296940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1cab-e773-4cb3-a6ea-e2c8af2c87bb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.297400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e1cab-e773-4cb3-a6ea-e2c8af2c87bb None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.298351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e1cab-e773-4cb3-a6ea-e2c8af2c87bb None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:03.298854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e1cab-e773-4cb3-a6ea-e2c8af2c87bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:03.301050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e1cab-e773-4cb3-a6ea-e2c8af2c87bb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:03.310121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 51/106] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:03.311969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c044a9-1fd9-4c34-9153-959f81aa0f3a None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.312499 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c044a9-1fd9-4c34-9153-959f81aa0f3a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.312964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c044a9-1fd9-4c34-9153-959f81aa0f3a None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.314397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 52/107] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:03.316115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c044a9-1fd9-4c34-9153-959f81aa0f3a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:03.353053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:03.389444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e5afd-555a-4cb4-9fca-34a14d9e7fa1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:03.428482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21886266-6418-4fb3-af59-5e2db00e7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:03.428834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886266-6418-4fb3-af59-5e2db00e7f80 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.429074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886266-6418-4fb3-af59-5e2db00e7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.429354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21886266-6418-4fb3-af59-5e2db00e7f80 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.430012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21886266-6418-4fb3-af59-5e2db00e7f80 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:03.431478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21886266-6418-4fb3-af59-5e2db00e7f80 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:03.468249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 56/108] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:32:03 2022] POST /identity/v3/projects => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:03.476094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e93bd-dd86-4513-ac7b-17676cab4a62 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.476793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e93bd-dd86-4513-ac7b-17676cab4a62 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.477080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e93bd-dd86-4513-ac7b-17676cab4a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.515038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c044a9-1fd9-4c34-9153-959f81aa0f3a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:03.537629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c16e93bd-dd86-4513-ac7b-17676cab4a62 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:03.539224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c16e93bd-dd86-4513-ac7b-17676cab4a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:03.564357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d7e9c-2d67-43ab-bf52-5f4e115e6d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:03.565108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d7e9c-2d67-43ab-bf52-5f4e115e6d29 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.565395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d7e9c-2d67-43ab-bf52-5f4e115e6d29 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.565675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d7e9c-2d67-43ab-bf52-5f4e115e6d29 None admin] PATH_INFO: `/v3/users/3ed9a17bcc6949d6bda080925888a735` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.567899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:03.583491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d7e9c-2d67-43ab-bf52-5f4e115e6d29 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed9a17bcc6949d6bda080925888a735)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:03.585041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d7e9c-2d67-43ab-bf52-5f4e115e6d29 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:03.586870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 53/109] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:03 2022] GET /identity/v3/users/3ed9a17bcc6949d6bda080925888a735 => generated 289 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:03.588098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383e19-0223-43ea-8884-ae2ffd72b7df None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.588428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383e19-0223-43ea-8884-ae2ffd72b7df None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.588708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383e19-0223-43ea-8884-ae2ffd72b7df None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.590093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 54/110] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:03.590940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b596c-7ffc-4838-a4df-48734dc45ccc None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.591224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b596c-7ffc-4838-a4df-48734dc45ccc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.591743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b596c-7ffc-4838-a4df-48734dc45ccc None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.593277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 55/111] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:03.593901 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b596c-7ffc-4838-a4df-48734dc45ccc None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:03.634210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 57/112] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:03.635361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b8e9c-d7ef-4cbf-9cb5-aaf37604f660 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.635658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b8e9c-d7ef-4cbf-9cb5-aaf37604f660 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.635940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b8e9c-d7ef-4cbf-9cb5-aaf37604f660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.657965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-462b8e9c-d7ef-4cbf-9cb5-aaf37604f660 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:03.659216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-462b8e9c-d7ef-4cbf-9cb5-aaf37604f660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:03.720061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b596c-7ffc-4838-a4df-48734dc45ccc None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:03.735047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:03.757510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 58/113] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:03.758768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babd674-1454-4dd3-a7a6-79198e58e1a0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.759059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babd674-1454-4dd3-a7a6-79198e58e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.759334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babd674-1454-4dd3-a7a6-79198e58e1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.763230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837ef1b-0dc0-46e8-a6dd-c8c1240fb213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:03.763840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ef1b-0dc0-46e8-a6dd-c8c1240fb213 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:03.764123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ef1b-0dc0-46e8-a6dd-c8c1240fb213 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:03.764437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837ef1b-0dc0-46e8-a6dd-c8c1240fb213 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:03.790267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3babd674-1454-4dd3-a7a6-79198e58e1a0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:03.792392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3babd674-1454-4dd3-a7a6-79198e58e1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:03.838503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:03.850640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837ef1b-0dc0-46e8-a6dd-c8c1240fb213 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:03.852678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837ef1b-0dc0-46e8-a6dd-c8c1240fb213 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:03.878445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 59/114] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:03.880017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babd674-1454-4dd3-a7a6-79198e58e1a0 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:03.969648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 56/115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:03.976258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837ef1b-0dc0-46e8-a6dd-c8c1240fb213 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:03.999347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babd674-1454-4dd3-a7a6-79198e58e1a0 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.020453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:04.044950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fd506-ce39-4094-b652-6ae23213f460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.044950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fd506-ce39-4094-b652-6ae23213f460 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.044950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fd506-ce39-4094-b652-6ae23213f460 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.044950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fd506-ce39-4094-b652-6ae23213f460 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.065213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fd506-ce39-4094-b652-6ae23213f460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-f10fd506-ce39-4094-b652-6ae23213f460 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:04.070119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:04.070942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:04.071702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:04.076519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 60/116] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:04.083203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fd506-ce39-4094-b652-6ae23213f460 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.127608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:04.138224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837ef1b-0dc0-46e8-a6dd-c8c1240fb213 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.180006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eadfa3-3d54-46b1-8000-33d8451dab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.180665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadfa3-3d54-46b1-8000-33d8451dab11 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.180945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadfa3-3d54-46b1-8000-33d8451dab11 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.181218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eadfa3-3d54-46b1-8000-33d8451dab11 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.182354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eadfa3-3d54-46b1-8000-33d8451dab11 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:04.183797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eadfa3-3d54-46b1-8000-33d8451dab11 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:04.185529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 57/117] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:03 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:04.186296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eadfa3-3d54-46b1-8000-33d8451dab11 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.224298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fd506-ce39-4094-b652-6ae23213f460 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.263212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3160404-4c89-4a64-9f87-f6bdb6d3652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.263847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3160404-4c89-4a64-9f87-f6bdb6d3652d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.264135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3160404-4c89-4a64-9f87-f6bdb6d3652d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.264458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3160404-4c89-4a64-9f87-f6bdb6d3652d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.275711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3160404-4c89-4a64-9f87-f6bdb6d3652d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-b3160404-4c89-4a64-9f87-f6bdb6d3652d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:04.280587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:04.281434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:04.282350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 61/118] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:04.282976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3160404-4c89-4a64-9f87-f6bdb6d3652d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.311320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eadfa3-3d54-46b1-8000-33d8451dab11 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.325311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:04.351799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.352457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.352740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.353012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.353672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:04.353974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:04.355739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:04.364464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 58/119] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:04.365309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.394328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:04.394497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3160404-4c89-4a64-9f87-f6bdb6d3652d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.430274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70cb20-d5be-4a4a-a222-0b3431d771f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.430900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70cb20-d5be-4a4a-a222-0b3431d771f8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.431187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70cb20-d5be-4a4a-a222-0b3431d771f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.431464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa70cb20-d5be-4a4a-a222-0b3431d771f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.441893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa70cb20-d5be-4a4a-a222-0b3431d771f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-fa70cb20-d5be-4a4a-a222-0b3431d771f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:04.446754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:04.447604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:04.448378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 62/120] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:04.448993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70cb20-d5be-4a4a-a222-0b3431d771f8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.488459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68bdea-c1cc-4a4a-a906-0a23740a9c37 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.522640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.523240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.523523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.524411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.524585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] RBAC: Adding query filter params (role.id=e88008987bf44713a9598a0e5b5ff146, scope.project.id=03aab93361d540d59cc78163f7da6239, user.id=3ed9a17bcc6949d6bda080925888a735) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:04.524842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:04.526286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:04.532458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 59/121] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/role_assignments?user.id=3ed9a17bcc6949d6bda080925888a735&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=e88008987bf44713a9598a0e5b5ff146 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:04.533145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.560995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:04.568656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa70cb20-d5be-4a4a-a222-0b3431d771f8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.610690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764fb7d-9670-421d-8185-806f318f2c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.611606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764fb7d-9670-421d-8185-806f318f2c07 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.612051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764fb7d-9670-421d-8185-806f318f2c07 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.612835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764fb7d-9670-421d-8185-806f318f2c07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.625787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e764fb7d-9670-421d-8185-806f318f2c07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e764fb7d-9670-421d-8185-806f318f2c07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:04.631467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:04.632589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:04.633422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:04.634460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:04.636637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 63/122] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:04.637894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764fb7d-9670-421d-8185-806f318f2c07 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.652966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd1fc2-0022-4eb0-8cfc-7c23a3ee15a0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.691048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.691698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.691988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.692292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.692963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:04.693263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:04.694689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:04.704205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 60/123] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:04.705087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.766685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764fb7d-9670-421d-8185-806f318f2c07 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.809506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067fa69-c491-4018-8b92-1e769dcea726 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.814296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937141e-b4cc-4e9e-b9f0-6deb4ab2c497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.815282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937141e-b4cc-4e9e-b9f0-6deb4ab2c497 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.815789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937141e-b4cc-4e9e-b9f0-6deb4ab2c497 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.816359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937141e-b4cc-4e9e-b9f0-6deb4ab2c497 None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.817848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937141e-b4cc-4e9e-b9f0-6deb4ab2c497 None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:04.819755 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937141e-b4cc-4e9e-b9f0-6deb4ab2c497 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:04.821800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 64/124] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:04.822794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937141e-b4cc-4e9e-b9f0-6deb4ab2c497 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.851078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.851696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.851975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.852278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.852952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:04.853253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:04.854712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:04.857575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:04.863339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 61/125] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:04.864560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:04.877147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:04.946706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937141e-b4cc-4e9e-b9f0-6deb4ab2c497 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.970265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a834f-ae60-4887-bbd9-db3b1fda576a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:04.988928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:04.989815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:04.990302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:04.990749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:04.991691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:04.992189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:04.993772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.004445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 65/126] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:05.005910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.006935 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866b14f-60bb-48f2-9b65-965972a26ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.007618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b14f-60bb-48f2-9b65-965972a26ede None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.007967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b14f-60bb-48f2-9b65-965972a26ede None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.008356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866b14f-60bb-48f2-9b65-965972a26ede None admin] PATH_INFO: `/v3/users/07cf079d1e524f8aa193b1bfe9096586` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.009640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866b14f-60bb-48f2-9b65-965972a26ede None admin] RBAC: Authorizing `identity:get_user(user_id=07cf079d1e524f8aa193b1bfe9096586)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.011223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866b14f-60bb-48f2-9b65-965972a26ede None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.012917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 62/127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:04 2022] GET /identity/v3/users/07cf079d1e524f8aa193b1bfe9096586 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:05.013858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866b14f-60bb-48f2-9b65-965972a26ede None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.098547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:05.122382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866b14f-60bb-48f2-9b65-965972a26ede None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.132574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:05.148824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98190-776e-4f17-b1ad-3327ae108973 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.165562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140057b-53c6-4632-96e9-314b57097577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.166203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140057b-53c6-4632-96e9-314b57097577 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.166702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140057b-53c6-4632-96e9-314b57097577 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.166984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140057b-53c6-4632-96e9-314b57097577 None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.168483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140057b-53c6-4632-96e9-314b57097577 None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.169937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140057b-53c6-4632-96e9-314b57097577 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.172965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 63/128] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:05 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:05.176701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140057b-53c6-4632-96e9-314b57097577 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.197900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983cde-70d9-45a5-b470-a7f2c48acb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.198546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983cde-70d9-45a5-b470-a7f2c48acb01 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.198827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983cde-70d9-45a5-b470-a7f2c48acb01 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.199100 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2983cde-70d9-45a5-b470-a7f2c48acb01 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.200799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2983cde-70d9-45a5-b470-a7f2c48acb01 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.202684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2983cde-70d9-45a5-b470-a7f2c48acb01 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.206011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 66/129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:05 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:05.206813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983cde-70d9-45a5-b470-a7f2c48acb01 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.289690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140057b-53c6-4632-96e9-314b57097577 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.325463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ba9f0-f3bb-43fa-b6a8-55c73ac1b345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.326068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ba9f0-f3bb-43fa-b6a8-55c73ac1b345 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.326353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ba9f0-f3bb-43fa-b6a8-55c73ac1b345 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.326628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ba9f0-f3bb-43fa-b6a8-55c73ac1b345 None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.328546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ba9f0-f3bb-43fa-b6a8-55c73ac1b345 None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.330526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ba9f0-f3bb-43fa-b6a8-55c73ac1b345 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.332219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 64/130] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:05 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:05.333006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ba9f0-f3bb-43fa-b6a8-55c73ac1b345 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.334109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2983cde-70d9-45a5-b470-a7f2c48acb01 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.350161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:05.380852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e63e2-3fc6-43ac-8025-d7d40024f1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.381790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e63e2-3fc6-43ac-8025-d7d40024f1aa None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.382086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e63e2-3fc6-43ac-8025-d7d40024f1aa None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.382364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e63e2-3fc6-43ac-8025-d7d40024f1aa None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.383834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e63e2-3fc6-43ac-8025-d7d40024f1aa None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.385943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e63e2-3fc6-43ac-8025-d7d40024f1aa None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.388321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 67/131] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:05 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:05.389079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e63e2-3fc6-43ac-8025-d7d40024f1aa None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.422105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:05.445318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ba9f0-f3bb-43fa-b6a8-55c73ac1b345 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.492204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f95c56-4498-406f-9816-b815eb0477bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.493226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95c56-4498-406f-9816-b815eb0477bb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.493517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95c56-4498-406f-9816-b815eb0477bb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.493799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f95c56-4498-406f-9816-b815eb0477bb None admin] PATH_INFO: `/v3/projects/b58e35fc963e4981b21637950848c090` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.494953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f95c56-4498-406f-9816-b815eb0477bb None admin] RBAC: Authorizing `identity:get_project(project_id=b58e35fc963e4981b21637950848c090)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.496476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f95c56-4498-406f-9816-b815eb0477bb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.500240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 65/132] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:05 2022] GET /identity/v3/projects/b58e35fc963e4981b21637950848c090 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:05.501289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f95c56-4498-406f-9816-b815eb0477bb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.522156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e63e2-3fc6-43ac-8025-d7d40024f1aa None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.572507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d14199-e4f6-4242-8f45-8e67acef96ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.573180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14199-e4f6-4242-8f45-8e67acef96ca None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.573461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14199-e4f6-4242-8f45-8e67acef96ca None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.573737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d14199-e4f6-4242-8f45-8e67acef96ca None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239/users/ece3258dc3b7408eb33f44129658af4e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.575832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d14199-e4f6-4242-8f45-8e67acef96ca None admin] RBAC: Authorizing `identity:create_grant(project_id=03aab93361d540d59cc78163f7da6239, user_id=ece3258dc3b7408eb33f44129658af4e, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.578479 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d14199-e4f6-4242-8f45-8e67acef96ca None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.597065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:05.599795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 68/133] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:05 2022] PUT /identity/v3/projects/03aab93361d540d59cc78163f7da6239/users/ece3258dc3b7408eb33f44129658af4e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:05.600757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d14199-e4f6-4242-8f45-8e67acef96ca None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.623850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f95c56-4498-406f-9816-b815eb0477bb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.689419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0616d-3655-43a7-b59e-06e089db8c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.690077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0616d-3655-43a7-b59e-06e089db8c95 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.691617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0616d-3655-43a7-b59e-06e089db8c95 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.691902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0616d-3655-43a7-b59e-06e089db8c95 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.693411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0616d-3655-43a7-b59e-06e089db8c95 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.696544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0616d-3655-43a7-b59e-06e089db8c95 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.700693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 66/134] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:05 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:05.703386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0616d-3655-43a7-b59e-06e089db8c95 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.767829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:05.791465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d14199-e4f6-4242-8f45-8e67acef96ca None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.830075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93695969-fc46-4109-97e0-262741778fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.830744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695969-fc46-4109-97e0-262741778fda None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.831026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695969-fc46-4109-97e0-262741778fda None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.831301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93695969-fc46-4109-97e0-262741778fda None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239/users/07cf079d1e524f8aa193b1bfe9096586/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.834665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93695969-fc46-4109-97e0-262741778fda None admin] RBAC: Authorizing `identity:create_grant(project_id=03aab93361d540d59cc78163f7da6239, user_id=07cf079d1e524f8aa193b1bfe9096586, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.836914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93695969-fc46-4109-97e0-262741778fda None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.855907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 69/135] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:05 2022] PUT /identity/v3/projects/03aab93361d540d59cc78163f7da6239/users/07cf079d1e524f8aa193b1bfe9096586/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:05.856981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93695969-fc46-4109-97e0-262741778fda None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:05.867044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0616d-3655-43a7-b59e-06e089db8c95 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:05.906010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def667ba-2505-4ae4-a892-afe5726703fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:05.906752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def667ba-2505-4ae4-a892-afe5726703fc None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.907040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def667ba-2505-4ae4-a892-afe5726703fc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.907310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def667ba-2505-4ae4-a892-afe5726703fc None admin] PATH_INFO: `/v3/projects/b58e35fc963e4981b21637950848c090/users/ece3258dc3b7408eb33f44129658af4e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.915738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def667ba-2505-4ae4-a892-afe5726703fc None admin] RBAC: Authorizing `identity:create_grant(project_id=b58e35fc963e4981b21637950848c090, user_id=ece3258dc3b7408eb33f44129658af4e, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:05.918619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def667ba-2505-4ae4-a892-afe5726703fc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:05.951554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 67/136] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:05 2022] PUT /identity/v3/projects/b58e35fc963e4981b21637950848c090/users/ece3258dc3b7408eb33f44129658af4e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:05.953620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a34b19-b327-48f6-832c-5277524d1db0 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.954155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a34b19-b327-48f6-832c-5277524d1db0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.954629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a34b19-b327-48f6-832c-5277524d1db0 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:05.960376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 68/137] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:05.962162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd0e7-33e2-410f-a045-07b20fa93b6b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:05.962707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd0e7-33e2-410f-a045-07b20fa93b6b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:05.963173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd0e7-33e2-410f-a045-07b20fa93b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:06.004703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a03fd0e7-33e2-410f-a045-07b20fa93b6b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:06.006261 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a03fd0e7-33e2-410f-a045-07b20fa93b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:06.012952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93695969-fc46-4109-97e0-262741778fda None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:06.028394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:06.064095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad78306-9715-44b2-995e-cb45a3b6eb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:06.065021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad78306-9715-44b2-995e-cb45a3b6eb2d None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:06.065308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad78306-9715-44b2-995e-cb45a3b6eb2d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:06.065916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad78306-9715-44b2-995e-cb45a3b6eb2d None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239/users/ece3258dc3b7408eb33f44129658af4e/roles/7f637775fa4c48a194ebb4513effa6b9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:06.070764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad78306-9715-44b2-995e-cb45a3b6eb2d None admin] RBAC: Authorizing `identity:create_grant(project_id=03aab93361d540d59cc78163f7da6239, user_id=ece3258dc3b7408eb33f44129658af4e, role_id=7f637775fa4c48a194ebb4513effa6b9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:06.073253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad78306-9715-44b2-995e-cb45a3b6eb2d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:06.096477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 70/138] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:05 2022] PUT /identity/v3/projects/03aab93361d540d59cc78163f7da6239/users/ece3258dc3b7408eb33f44129658af4e/roles/7f637775fa4c48a194ebb4513effa6b9 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:06.119484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 69/139] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:06.434814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad78306-9715-44b2-995e-cb45a3b6eb2d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:06.439599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:06.544870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad78306-9715-44b2-995e-cb45a3b6eb2d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:06.581531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089c818-d707-48dd-84cf-9b859c97cbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:06.582506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c818-d707-48dd-84cf-9b859c97cbf6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:06.583027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c818-d707-48dd-84cf-9b859c97cbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:06.583518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089c818-d707-48dd-84cf-9b859c97cbf6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:06.584889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089c818-d707-48dd-84cf-9b859c97cbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:06.586575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089c818-d707-48dd-84cf-9b859c97cbf6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:06.588759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 71/140] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:06.595219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fd0e7-33e2-410f-a045-07b20fa93b6b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:06.735166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fd0e7-33e2-410f-a045-07b20fa93b6b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:06.786001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa2ee5-cb31-4dc6-a4ff-93c7a5921640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:06.786615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ee5-cb31-4dc6-a4ff-93c7a5921640 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:06.786897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ee5-cb31-4dc6-a4ff-93c7a5921640 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:06.787170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa2ee5-cb31-4dc6-a4ff-93c7a5921640 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:06.787832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa2ee5-cb31-4dc6-a4ff-93c7a5921640 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:06.789299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa2ee5-cb31-4dc6-a4ff-93c7a5921640 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:06.803971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:06.822764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 70/141] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:06 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:06.958832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f743f-4867-482a-b73e-661368bf42c3 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:06.959507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f743f-4867-482a-b73e-661368bf42c3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:06.959994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f743f-4867-482a-b73e-661368bf42c3 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:06.961579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 72/142] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:06.967427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2dcdd-2d43-4457-b694-f1b39514dbfa None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:06.968318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2dcdd-2d43-4457-b694-f1b39514dbfa None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:06.968512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2dcdd-2d43-4457-b694-f1b39514dbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:06.996510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8dd2dcdd-2d43-4457-b694-f1b39514dbfa None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:06.997698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8dd2dcdd-2d43-4457-b694-f1b39514dbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:07.094419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 71/143] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:07.454650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f743f-4867-482a-b73e-661368bf42c3 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:07.541987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:07.581457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f743f-4867-482a-b73e-661368bf42c3 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:07.631540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f17fa-6b37-4746-8156-bdb3f4f41b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:07.632206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f17fa-6b37-4746-8156-bdb3f4f41b5a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:07.632528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f17fa-6b37-4746-8156-bdb3f4f41b5a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:07.632803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f17fa-6b37-4746-8156-bdb3f4f41b5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:07.647339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f17fa-6b37-4746-8156-bdb3f4f41b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-637f17fa-6b37-4746-8156-bdb3f4f41b5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:07.652516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:07.654082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:07.655118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:07.659377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 73/144] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:07.660883 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2dcdd-2d43-4457-b694-f1b39514dbfa None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:07.790425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2dcdd-2d43-4457-b694-f1b39514dbfa None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:07.819452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:07.829743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:07.830364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:07.830646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:07.830917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:07.831599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:07.831902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:07.833366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:07.842650 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 72/145] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:07.848156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f17fa-6b37-4746-8156-bdb3f4f41b5a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:07.969484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f17fa-6b37-4746-8156-bdb3f4f41b5a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:08.006494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:08.013206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b04b6-d332-4556-ab6e-20abca359b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:08.013904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b04b6-d332-4556-ab6e-20abca359b66 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:08.014185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b04b6-d332-4556-ab6e-20abca359b66 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:08.014452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b04b6-d332-4556-ab6e-20abca359b66 None admin] PATH_INFO: `/v3/users/3ed9a17bcc6949d6bda080925888a735` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:08.015827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b04b6-d332-4556-ab6e-20abca359b66 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed9a17bcc6949d6bda080925888a735)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:08.017403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b04b6-d332-4556-ab6e-20abca359b66 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:08.019327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 74/146] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:07 2022] GET /identity/v3/users/3ed9a17bcc6949d6bda080925888a735 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:08.025249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:08.164885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c7d20-8d7a-495b-aa9f-fadb6ae439da None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:08.215935 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c302380-79da-4c1f-97eb-a554b435da45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:08.216835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302380-79da-4c1f-97eb-a554b435da45 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:08.217123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302380-79da-4c1f-97eb-a554b435da45 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:08.217540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c302380-79da-4c1f-97eb-a554b435da45 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:08.218721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c302380-79da-4c1f-97eb-a554b435da45 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:08.220210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c302380-79da-4c1f-97eb-a554b435da45 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:08.222322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 73/147] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:08 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:08.228102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b04b6-d332-4556-ab6e-20abca359b66 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:08.387592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b04b6-d332-4556-ab6e-20abca359b66 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:08.431561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d2395-a64d-4c49-83a6-ea00c2203800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:08.432256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2395-a64d-4c49-83a6-ea00c2203800 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:08.432538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2395-a64d-4c49-83a6-ea00c2203800 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:08.432812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d2395-a64d-4c49-83a6-ea00c2203800 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239/users/3ed9a17bcc6949d6bda080925888a735/roles/e88008987bf44713a9598a0e5b5ff146` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:08.435626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d2395-a64d-4c49-83a6-ea00c2203800 None admin] RBAC: Authorizing `identity:create_grant(project_id=03aab93361d540d59cc78163f7da6239, user_id=3ed9a17bcc6949d6bda080925888a735, role_id=e88008987bf44713a9598a0e5b5ff146)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:08.437195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d2395-a64d-4c49-83a6-ea00c2203800 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:08.458819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 75/148] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:08 2022] PUT /identity/v3/projects/03aab93361d540d59cc78163f7da6239/users/3ed9a17bcc6949d6bda080925888a735/roles/e88008987bf44713a9598a0e5b5ff146 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:08.793087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac82d-db2b-4be0-ae4a-5c9f8de18ef3 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:08.793636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac82d-db2b-4be0-ae4a-5c9f8de18ef3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:08.793636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eac82d-db2b-4be0-ae4a-5c9f8de18ef3 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:08.794965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 74/149] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:08.800529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5811-fa13-4289-81bf-9086463aff6b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:08.800820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5811-fa13-4289-81bf-9086463aff6b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:08.801161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab5811-fa13-4289-81bf-9086463aff6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:08.829255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9fab5811-fa13-4289-81bf-9086463aff6b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:08.830460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9fab5811-fa13-4289-81bf-9086463aff6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:08.895097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:08.910674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 76/150] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:09.062007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700dc7-c981-4916-9670-b926cfd432a8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:09.062305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700dc7-c981-4916-9670-b926cfd432a8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:09.062476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d700dc7-c981-4916-9670-b926cfd432a8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:09.063817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 75/151] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:09.074567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d5cf-ef42-4121-86b7-9ffdea9ceb46 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:09.075198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d5cf-ef42-4121-86b7-9ffdea9ceb46 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:09.075902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7d5cf-ef42-4121-86b7-9ffdea9ceb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:09.105779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-52f7d5cf-ef42-4121-86b7-9ffdea9ceb46 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:09.107524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-52f7d5cf-ef42-4121-86b7-9ffdea9ceb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:09.185419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 77/152] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:09.497729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad860c-477c-42bd-91cb-19418877787b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:09.498011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad860c-477c-42bd-91cb-19418877787b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:09.498290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad860c-477c-42bd-91cb-19418877787b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:09.499785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 76/153] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:09.514528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d82954-d6b4-4789-adb2-d1ce9e13ffc6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:09.515464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d82954-d6b4-4789-adb2-d1ce9e13ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:09.515955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d82954-d6b4-4789-adb2-d1ce9e13ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:09.537147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b3d82954-d6b4-4789-adb2-d1ce9e13ffc6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:09.538686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b3d82954-d6b4-4789-adb2-d1ce9e13ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:09.564732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad860c-477c-42bd-91cb-19418877787b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:09.618575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 78/154] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:09.673303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:09.731091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03e9e-156c-46c9-96ce-f3472dcd2bab None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:09.731423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03e9e-156c-46c9-96ce-f3472dcd2bab None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:09.731702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc03e9e-156c-46c9-96ce-f3472dcd2bab None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:09.733361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 79/155] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:09.738596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22db0-b984-438c-9c26-e549548ee6a8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:09.738884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22db0-b984-438c-9c26-e549548ee6a8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:09.739164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a22db0-b984-438c-9c26-e549548ee6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:09.749866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad860c-477c-42bd-91cb-19418877787b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:09.777763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-87a22db0-b984-438c-9c26-e549548ee6a8 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:09.779075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-87a22db0-b984-438c-9c26-e549548ee6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:09.799411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c84b60-c707-4b85-86b8-2f025d8a5a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:09.800058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c84b60-c707-4b85-86b8-2f025d8a5a28 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:09.800346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c84b60-c707-4b85-86b8-2f025d8a5a28 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:09.800621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c84b60-c707-4b85-86b8-2f025d8a5a28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:09.817455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c84b60-c707-4b85-86b8-2f025d8a5a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-32c84b60-c707-4b85-86b8-2f025d8a5a28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:09.823108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:09.824434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:09.825233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 77/156] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:09.832376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c84b60-c707-4b85-86b8-2f025d8a5a28 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:09.855636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:09.885730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 80/157] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:09.890937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22db0-b984-438c-9c26-e549548ee6a8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:09.985489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c84b60-c707-4b85-86b8-2f025d8a5a28 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.010287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a22db0-b984-438c-9c26-e549548ee6a8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.013027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:10.047649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a08f-6077-49de-befb-ddb74634bf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.048327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a08f-6077-49de-befb-ddb74634bf78 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.048609 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a08f-6077-49de-befb-ddb74634bf78 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.048843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.048979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27a08f-6077-49de-befb-ddb74634bf78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.049713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.050126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.050537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.051347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:10.051795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:10.053328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:10.060106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27a08f-6077-49de-befb-ddb74634bf78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:10.062232 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 78/158] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-cc27a08f-6077-49de-befb-ddb74634bf78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:10.066552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:10.067593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:10.068461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 81/159] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:10.069976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:10.076824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a08f-6077-49de-befb-ddb74634bf78 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:10.169325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:10.263270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27a08f-6077-49de-befb-ddb74634bf78 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.309214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29eea06-0dbd-488a-a211-337e90a62038 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.313506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.314317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.314738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.315158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.315958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:10.316431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:10.318144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:10.328121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 82/160] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:10.329229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:10.362507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288513d4-9bd2-4da7-98f8-97393b76bbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.363407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288513d4-9bd2-4da7-98f8-97393b76bbf8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.363850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288513d4-9bd2-4da7-98f8-97393b76bbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.364291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288513d4-9bd2-4da7-98f8-97393b76bbf8 None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.365606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288513d4-9bd2-4da7-98f8-97393b76bbf8 None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:10.367270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288513d4-9bd2-4da7-98f8-97393b76bbf8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:10.369342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 79/161] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:10 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:10.370401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288513d4-9bd2-4da7-98f8-97393b76bbf8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:10.445979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:10.479378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ff5bd-017b-47c2-95ff-c9ec14446044 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.500274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:10.529814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288513d4-9bd2-4da7-98f8-97393b76bbf8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.536383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdeb2b-b878-4f37-867f-8741057f2f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.537080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdeb2b-b878-4f37-867f-8741057f2f92 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.537359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdeb2b-b878-4f37-867f-8741057f2f92 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.537637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecdeb2b-b878-4f37-867f-8741057f2f92 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.557109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecdeb2b-b878-4f37-867f-8741057f2f92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3ecdeb2b-b878-4f37-867f-8741057f2f92 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:10.563244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:10.564230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:10.565022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 83/162] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:10.565715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdeb2b-b878-4f37-867f-8741057f2f92 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:10.589281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a19ae-b059-48bc-9864-302f5f104dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.590164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a19ae-b059-48bc-9864-302f5f104dee None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.590609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a19ae-b059-48bc-9864-302f5f104dee None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.591106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a19ae-b059-48bc-9864-302f5f104dee None admin] PATH_INFO: `/v3/users/07cf079d1e524f8aa193b1bfe9096586` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.596920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a19ae-b059-48bc-9864-302f5f104dee None admin] RBAC: Authorizing `identity:get_user(user_id=07cf079d1e524f8aa193b1bfe9096586)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:10.598601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a19ae-b059-48bc-9864-302f5f104dee None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:10.600449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 80/163] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:10 2022] GET /identity/v3/users/07cf079d1e524f8aa193b1bfe9096586 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:10.601462 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a19ae-b059-48bc-9864-302f5f104dee None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:10.700928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecdeb2b-b878-4f37-867f-8741057f2f92 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.715792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a19ae-b059-48bc-9864-302f5f104dee None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.732490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:10.754604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.755570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.756101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.756664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.757421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4e48a-652c-408e-8e75-3eaaa5b58a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.757794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:10.758039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e48a-652c-408e-8e75-3eaaa5b58a67 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.758321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e48a-652c-408e-8e75-3eaaa5b58a67 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.758590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4e48a-652c-408e-8e75-3eaaa5b58a67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.758887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:10.761451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:10.770505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 81/164] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:10.771686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:10.828622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:10.883026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8b75e-53fd-4391-a0d7-7162cef55d60 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:10.925808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf31aa-31ec-4175-a2c6-67dc10d8b623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:10.926908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf31aa-31ec-4175-a2c6-67dc10d8b623 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:10.927431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf31aa-31ec-4175-a2c6-67dc10d8b623 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:10.927902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf31aa-31ec-4175-a2c6-67dc10d8b623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:10.965044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e48a-652c-408e-8e75-3eaaa5b58a67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:10.966557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4e48a-652c-408e-8e75-3eaaa5b58a67 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:10.986154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:11.009450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf31aa-31ec-4175-a2c6-67dc10d8b623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:11.011766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf31aa-31ec-4175-a2c6-67dc10d8b623 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:11.096399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 84/165] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:11.097295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4e48a-652c-408e-8e75-3eaaa5b58a67 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:11.148342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 82/166] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:11.149531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf31aa-31ec-4175-a2c6-67dc10d8b623 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:11.183583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:11.252527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:11.274358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf31aa-31ec-4175-a2c6-67dc10d8b623 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:11.299664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4e48a-652c-408e-8e75-3eaaa5b58a67 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:11.340795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b152ae9-cc1a-4fcb-b0a2-7cdf68aec275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:11.341436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b152ae9-cc1a-4fcb-b0a2-7cdf68aec275 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:11.341720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b152ae9-cc1a-4fcb-b0a2-7cdf68aec275 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:11.341993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b152ae9-cc1a-4fcb-b0a2-7cdf68aec275 None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:11.343275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b152ae9-cc1a-4fcb-b0a2-7cdf68aec275 None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:11.345038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b152ae9-cc1a-4fcb-b0a2-7cdf68aec275 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:11.346849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 83/167] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:11 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:11.347751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61571-579b-4a28-8ce6-255125fb158d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:11.348034 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61571-579b-4a28-8ce6-255125fb158d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:11.354658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa61571-579b-4a28-8ce6-255125fb158d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:11.356269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 84/168] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:11.356876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61571-579b-4a28-8ce6-255125fb158d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:11.373248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb355c2-2561-420d-8965-d08e1c5b577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:11.373774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb355c2-2561-420d-8965-d08e1c5b577c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:11.374055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb355c2-2561-420d-8965-d08e1c5b577c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:11.374337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb355c2-2561-420d-8965-d08e1c5b577c None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:11.391286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb355c2-2561-420d-8965-d08e1c5b577c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ffb355c2-2561-420d-8965-d08e1c5b577c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:11.396257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:11.397205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:11.397985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 85/169] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:11.398636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb355c2-2561-420d-8965-d08e1c5b577c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:11.509739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb355c2-2561-420d-8965-d08e1c5b577c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:11.552012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:11.577017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0dd35-02de-4500-9dd1-3bc8c246305b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:11.577664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0dd35-02de-4500-9dd1-3bc8c246305b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:11.577947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0dd35-02de-4500-9dd1-3bc8c246305b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:11.578219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0dd35-02de-4500-9dd1-3bc8c246305b None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:11.581175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0dd35-02de-4500-9dd1-3bc8c246305b None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:11.582684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0dd35-02de-4500-9dd1-3bc8c246305b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:11.590867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 86/170] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:11 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:11.598247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d83c-4472-42be-b83b-d94f2056ca6f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:11.598463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d83c-4472-42be-b83b-d94f2056ca6f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:11.598743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d83c-4472-42be-b83b-d94f2056ca6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:11.611246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa61571-579b-4a28-8ce6-255125fb158d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:11.627842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6296d83c-4472-42be-b83b-d94f2056ca6f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:11.629891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6296d83c-4472-42be-b83b-d94f2056ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:11.696270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4f5d2-a01b-4dd1-ae08-f28187debf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:11.698320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f5d2-a01b-4dd1-ae08-f28187debf40 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:11.698611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f5d2-a01b-4dd1-ae08-f28187debf40 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:11.698986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4f5d2-a01b-4dd1-ae08-f28187debf40 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:11.701080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4f5d2-a01b-4dd1-ae08-f28187debf40 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:11.704271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4f5d2-a01b-4dd1-ae08-f28187debf40 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:11.708107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 85/171] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:11 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:11.708736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4f5d2-a01b-4dd1-ae08-f28187debf40 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:11.742128 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:11.752644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 87/172] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:11.753935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d83c-4472-42be-b83b-d94f2056ca6f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:11.947729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d83c-4472-42be-b83b-d94f2056ca6f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:11.972574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:11.988807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:11.989424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:11.989707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:11.989984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:11.990711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:11.991021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:11.992461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:11.994634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4f5d2-a01b-4dd1-ae08-f28187debf40 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:12.002773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 88/173] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:12.003935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:12.061036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773a90f-e932-4834-b211-7a0cea6788f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:12.061720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a90f-e932-4834-b211-7a0cea6788f5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.062009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a90f-e932-4834-b211-7a0cea6788f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.062288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a90f-e932-4834-b211-7a0cea6788f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.114314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6630adb-7798-4a59-8b8d-043bcb365269 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:12.151691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:12.152882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.153007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773a90f-e932-4834-b211-7a0cea6788f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:12.153452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.153934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.154500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773a90f-e932-4834-b211-7a0cea6788f5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:12.154832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=03aab93361d540d59cc78163f7da6239, user.id=07cf079d1e524f8aa193b1bfe9096586) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:12.155138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:12.156772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:12.163774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 89/174] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:12 2022] GET /identity/v3/role_assignments?user.id=07cf079d1e524f8aa193b1bfe9096586&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:12.164661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:12.170834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:12.222757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:12.277167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 86/175] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:12.281791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851dd3e-1419-45ef-9f28-5b1b8f889e6a None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.282084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851dd3e-1419-45ef-9f28-5b1b8f889e6a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.282362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851dd3e-1419-45ef-9f28-5b1b8f889e6a None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.283757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 87/176] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:12.284528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851dd3e-1419-45ef-9f28-5b1b8f889e6a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:12.292600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6563c-5e4d-4a98-9aa5-149f02ab2227 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:12.335107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e9d7dd-677a-4b21-929a-c95850b91b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:12.336119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9d7dd-677a-4b21-929a-c95850b91b77 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.336516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9d7dd-677a-4b21-929a-c95850b91b77 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.336796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e9d7dd-677a-4b21-929a-c95850b91b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.337536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9d7dd-677a-4b21-929a-c95850b91b77 None admin] RBAC: Adding query filter params (role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=03aab93361d540d59cc78163f7da6239, user.id=ece3258dc3b7408eb33f44129658af4e) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:12.338532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9d7dd-677a-4b21-929a-c95850b91b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:12.340160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e9d7dd-677a-4b21-929a-c95850b91b77 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:12.347081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 90/177] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:12 2022] GET /identity/v3/role_assignments?user.id=ece3258dc3b7408eb33f44129658af4e&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:12.348129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474977b-94ff-4db1-ae69-eccab96d1252 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.349151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474977b-94ff-4db1-ae69-eccab96d1252 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.349433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474977b-94ff-4db1-ae69-eccab96d1252 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.350665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 91/178] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:12.352755 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474977b-94ff-4db1-ae69-eccab96d1252 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:12.433445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851dd3e-1419-45ef-9f28-5b1b8f889e6a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:12.450073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:12.475659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e55a227-eef5-46cd-9f0d-6ba57f4ef243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:12.476570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a227-eef5-46cd-9f0d-6ba57f4ef243 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.476858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a227-eef5-46cd-9f0d-6ba57f4ef243 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.477696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e55a227-eef5-46cd-9f0d-6ba57f4ef243 None admin] PATH_INFO: `/v3/users/ece3258dc3b7408eb33f44129658af4e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.479231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55a227-eef5-46cd-9f0d-6ba57f4ef243 None admin] RBAC: Authorizing `identity:get_user(user_id=ece3258dc3b7408eb33f44129658af4e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:12.479862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474977b-94ff-4db1-ae69-eccab96d1252 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:12.480748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e55a227-eef5-46cd-9f0d-6ba57f4ef243 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:12.482402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 88/179] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:12 2022] GET /identity/v3/users/ece3258dc3b7408eb33f44129658af4e => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:12.483628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc377-7923-429b-81e1-ced3d2a5081f None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.483910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc377-7923-429b-81e1-ced3d2a5081f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.484206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cdc377-7923-429b-81e1-ced3d2a5081f None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.485474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 89/180] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:12.486192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdc377-7923-429b-81e1-ced3d2a5081f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:12.497506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:12.527861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265c26b-b974-4934-b05a-89e5bf7885b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:12.528534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c26b-b974-4934-b05a-89e5bf7885b9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.528817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c26b-b974-4934-b05a-89e5bf7885b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.529799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265c26b-b974-4934-b05a-89e5bf7885b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.540711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265c26b-b974-4934-b05a-89e5bf7885b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-5265c26b-b974-4934-b05a-89e5bf7885b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:12.545731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:12.546610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:12.547780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 92/181] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:12.548649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37daca8-7cd1-40dd-8f47-7e5d068ec11e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.550008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37daca8-7cd1-40dd-8f47-7e5d068ec11e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.550300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37daca8-7cd1-40dd-8f47-7e5d068ec11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.570003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c37daca8-7cd1-40dd-8f47-7e5d068ec11e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:12.571737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c37daca8-7cd1-40dd-8f47-7e5d068ec11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:12.610928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cdc377-7923-429b-81e1-ced3d2a5081f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:12.640879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 93/182] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:12.642207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0847c33-77ca-4bd4-a460-f94d85898153 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.642505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0847c33-77ca-4bd4-a460-f94d85898153 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.642778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0847c33-77ca-4bd4-a460-f94d85898153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.651858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c1b82-472c-47eb-a6d8-90daed3196df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:12.652522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c1b82-472c-47eb-a6d8-90daed3196df None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.652805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c1b82-472c-47eb-a6d8-90daed3196df None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.653079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c1b82-472c-47eb-a6d8-90daed3196df None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.654235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c1b82-472c-47eb-a6d8-90daed3196df None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:12.655679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c1b82-472c-47eb-a6d8-90daed3196df None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:12.657486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 90/183] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:12 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:12.658589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9784b-2c43-45bd-a85a-a7a84b1c1342 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.658874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9784b-2c43-45bd-a85a-a7a84b1c1342 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.659150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9784b-2c43-45bd-a85a-a7a84b1c1342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.671668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a0847c33-77ca-4bd4-a460-f94d85898153 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:12.673227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a0847c33-77ca-4bd4-a460-f94d85898153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:12.677521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9cd9784b-2c43-45bd-a85a-a7a84b1c1342 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:12.678689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9cd9784b-2c43-45bd-a85a-a7a84b1c1342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:12.725651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:12.748603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 94/184] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:12.749344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0847c33-77ca-4bd4-a460-f94d85898153 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:12.762912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 91/185] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:12.764107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9784b-2c43-45bd-a85a-a7a84b1c1342 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:12.810540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:12.888134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd9784b-2c43-45bd-a85a-a7a84b1c1342 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:12.929473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:12.930948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:12.931422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:12.931923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:12.932910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:12.933420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:12.935088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:12.944015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 92/186] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:12.950018 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:12.957438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0847c33-77ca-4bd4-a460-f94d85898153 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.002862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231f764-43ab-4afd-91a6-8f388ed93112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.003388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.004843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f764-43ab-4afd-91a6-8f388ed93112 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.005320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f764-43ab-4afd-91a6-8f388ed93112 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.006288 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e231f764-43ab-4afd-91a6-8f388ed93112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.070189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d69c4-ef69-4c00-991f-13480684de57 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.083202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231f764-43ab-4afd-91a6-8f388ed93112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.084734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e231f764-43ab-4afd-91a6-8f388ed93112 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.106145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.106756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.107035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.107308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.108042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] RBAC: Adding query filter params (role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=03aab93361d540d59cc78163f7da6239, user.id=ece3258dc3b7408eb33f44129658af4e) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:13.108374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.109829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.115255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.115558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 93/187] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:12 2022] GET /identity/v3/role_assignments?user.id=ece3258dc3b7408eb33f44129658af4e&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:13.116388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.198546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 95/188] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:13.199425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231f764-43ab-4afd-91a6-8f388ed93112 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.236381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018794b-5b7f-43a2-b8a8-ddc8dd6fbd48 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.240252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.280363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ea974-18d4-453d-855a-680947d55673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.280682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ea974-18d4-453d-855a-680947d55673 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.281621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ea974-18d4-453d-855a-680947d55673 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.281621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ea974-18d4-453d-855a-680947d55673 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.292896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ea974-18d4-453d-855a-680947d55673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f58ea974-18d4-453d-855a-680947d55673 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:13.298821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:13.299702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 94/189] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:13.300501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ea974-18d4-453d-855a-680947d55673 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.313741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e231f764-43ab-4afd-91a6-8f388ed93112 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.348325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.354663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be70b-7be5-4ae1-8520-c3a93aa90e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.355282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be70b-7be5-4ae1-8520-c3a93aa90e9a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.355565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be70b-7be5-4ae1-8520-c3a93aa90e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.355838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be70b-7be5-4ae1-8520-c3a93aa90e9a None admin] PATH_INFO: `/v3/users/6ae273f07eb94c638a0a77866bdb6ff9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.369727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593be70b-7be5-4ae1-8520-c3a93aa90e9a None admin] RBAC: Authorizing `identity:get_user(user_id=6ae273f07eb94c638a0a77866bdb6ff9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.371193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593be70b-7be5-4ae1-8520-c3a93aa90e9a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.372893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 96/190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/users/6ae273f07eb94c638a0a77866bdb6ff9 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:13.373747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be70b-7be5-4ae1-8520-c3a93aa90e9a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.411537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ea974-18d4-453d-855a-680947d55673 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.444039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7917823-43c1-48e7-98df-6bceb931aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.444764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917823-43c1-48e7-98df-6bceb931aa31 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.445605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917823-43c1-48e7-98df-6bceb931aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.445884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7917823-43c1-48e7-98df-6bceb931aa31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.456406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7917823-43c1-48e7-98df-6bceb931aa31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f7917823-43c1-48e7-98df-6bceb931aa31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:13.461735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:13.462628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:13.463412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 95/191] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:13.464079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7917823-43c1-48e7-98df-6bceb931aa31 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.474940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be70b-7be5-4ae1-8520-c3a93aa90e9a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.487827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.509156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216664-74d0-4397-8f5f-b8c2e92dcd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.509985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216664-74d0-4397-8f5f-b8c2e92dcd0c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.510268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216664-74d0-4397-8f5f-b8c2e92dcd0c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.510542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f216664-74d0-4397-8f5f-b8c2e92dcd0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.511644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f216664-74d0-4397-8f5f-b8c2e92dcd0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.513251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f216664-74d0-4397-8f5f-b8c2e92dcd0c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.514814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 97/192] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:13.515660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216664-74d0-4397-8f5f-b8c2e92dcd0c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.564600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7917823-43c1-48e7-98df-6bceb931aa31 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.573260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.599039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7175ea-42d6-476f-a3f8-fda3138d5dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.599664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7175ea-42d6-476f-a3f8-fda3138d5dbe None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.599944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7175ea-42d6-476f-a3f8-fda3138d5dbe None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.600251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7175ea-42d6-476f-a3f8-fda3138d5dbe None admin] PATH_INFO: `/v3/projects/b58e35fc963e4981b21637950848c090` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.601945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7175ea-42d6-476f-a3f8-fda3138d5dbe None admin] RBAC: Authorizing `identity:get_project(project_id=b58e35fc963e4981b21637950848c090)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.603376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7175ea-42d6-476f-a3f8-fda3138d5dbe None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.609970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 96/193] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/projects/b58e35fc963e4981b21637950848c090 => generated 312 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:13.609970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7175ea-42d6-476f-a3f8-fda3138d5dbe None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.625595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f216664-74d0-4397-8f5f-b8c2e92dcd0c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.658466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.659057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.659335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.659603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.660292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:13.660594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.661977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.673321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 98/194] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:13.674158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.700919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.710395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7175ea-42d6-476f-a3f8-fda3138d5dbe None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.745251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec2ab9-5b7b-4fdc-8041-a9b0c3b2a7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.745853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2ab9-5b7b-4fdc-8041-a9b0c3b2a7c2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.746131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2ab9-5b7b-4fdc-8041-a9b0c3b2a7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.746400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2ab9-5b7b-4fdc-8041-a9b0c3b2a7c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.775303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1495ca8-8c34-4ad4-8b89-234789d59177 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.793131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.810916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.811520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.811802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.812076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.812774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:13.813075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.813376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec2ab9-5b7b-4fdc-8041-a9b0c3b2a7c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.814476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.814887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec2ab9-5b7b-4fdc-8041-a9b0c3b2a7c2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.823733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 99/195] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:13.825069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.906321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:13.916252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 97/196] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:13.917065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec2ab9-5b7b-4fdc-8041-a9b0c3b2a7c2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:13.929834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208f16c-db76-4808-88f7-c6008e41c6c7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:13.963548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5233f9-6f47-46e6-bb7b-d034ed615af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:13.964156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5233f9-6f47-46e6-bb7b-d034ed615af5 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:13.964470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5233f9-6f47-46e6-bb7b-d034ed615af5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:13.964746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5233f9-6f47-46e6-bb7b-d034ed615af5 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:13.965401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5233f9-6f47-46e6-bb7b-d034ed615af5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:13.967182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5233f9-6f47-46e6-bb7b-d034ed615af5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:13.993272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 100/197] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:13 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:13.994192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5233f9-6f47-46e6-bb7b-d034ed615af5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:14.021972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec2ab9-5b7b-4fdc-8041-a9b0c3b2a7c2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:14.036081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:14.066271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:14.066809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:14.067087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:14.067359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:14.068098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] RBAC: Adding query filter params (role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=b58e35fc963e4981b21637950848c090, user.id=ece3258dc3b7408eb33f44129658af4e) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:14.068442 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:14.070434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:14.077810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 98/198] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/role_assignments?user.id=ece3258dc3b7408eb33f44129658af4e&scope.project.id=b58e35fc963e4981b21637950848c090&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:14.079068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:14.134078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5233f9-6f47-46e6-bb7b-d034ed615af5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:14.159296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:14.189390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285fdcf-384a-4a71-b82f-ebd8755296fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:14.189390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fdcf-384a-4a71-b82f-ebd8755296fb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:14.189390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fdcf-384a-4a71-b82f-ebd8755296fb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:14.189390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285fdcf-384a-4a71-b82f-ebd8755296fb None admin] PATH_INFO: `/v3/users/6ae273f07eb94c638a0a77866bdb6ff9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:14.192584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285fdcf-384a-4a71-b82f-ebd8755296fb None admin] RBAC: Authorizing `identity:get_user(user_id=6ae273f07eb94c638a0a77866bdb6ff9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:14.195902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285fdcf-384a-4a71-b82f-ebd8755296fb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:14.197542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 101/199] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:13 2022] GET /identity/v3/users/6ae273f07eb94c638a0a77866bdb6ff9 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:14.198468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285fdcf-384a-4a71-b82f-ebd8755296fb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:14.219624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19145fc8-1cdf-436e-b4e7-19581d1c0443 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:14.267224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f4535-2ac5-4a71-b663-b397edf3f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:14.267597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f4535-2ac5-4a71-b663-b397edf3f535 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:14.268083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f4535-2ac5-4a71-b663-b397edf3f535 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:14.269608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578f4535-2ac5-4a71-b663-b397edf3f535 None admin] PATH_INFO: `/v3/users/3ed9a17bcc6949d6bda080925888a735` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:14.271383 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f4535-2ac5-4a71-b663-b397edf3f535 None admin] RBAC: Authorizing `identity:get_user(user_id=3ed9a17bcc6949d6bda080925888a735)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:14.274065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578f4535-2ac5-4a71-b663-b397edf3f535 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:14.276501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 99/200] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:14 2022] GET /identity/v3/users/3ed9a17bcc6949d6bda080925888a735 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:14.277180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f4535-2ac5-4a71-b663-b397edf3f535 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:14.331925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285fdcf-384a-4a71-b82f-ebd8755296fb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:14.334534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:14.379678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d176b41-b8a2-4ff8-a454-b8f5686fba96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:14.380905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176b41-b8a2-4ff8-a454-b8f5686fba96 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:14.381142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176b41-b8a2-4ff8-a454-b8f5686fba96 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:14.381394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d176b41-b8a2-4ff8-a454-b8f5686fba96 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:14.383171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d176b41-b8a2-4ff8-a454-b8f5686fba96 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:14.384693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d176b41-b8a2-4ff8-a454-b8f5686fba96 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:14.386706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 102/201] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:14 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:14.387501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d176b41-b8a2-4ff8-a454-b8f5686fba96 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:14.430104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578f4535-2ac5-4a71-b663-b397edf3f535 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:14.456160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:14.469697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17599e-674f-4e3c-aa81-190a98c1b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:14.470558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17599e-674f-4e3c-aa81-190a98c1b70e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:14.471032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17599e-674f-4e3c-aa81-190a98c1b70e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:14.471443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17599e-674f-4e3c-aa81-190a98c1b70e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:14.514203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d176b41-b8a2-4ff8-a454-b8f5686fba96 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:14.549686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979cf74-efb5-4d3f-9f77-6c25a2fa9a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:14.550311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979cf74-efb5-4d3f-9f77-6c25a2fa9a18 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:14.550595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979cf74-efb5-4d3f-9f77-6c25a2fa9a18 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:14.550870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979cf74-efb5-4d3f-9f77-6c25a2fa9a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:14.565990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17599e-674f-4e3c-aa81-190a98c1b70e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:14.568374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17599e-674f-4e3c-aa81-190a98c1b70e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:14.612579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:14.623705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979cf74-efb5-4d3f-9f77-6c25a2fa9a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:14.625425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979cf74-efb5-4d3f-9f77-6c25a2fa9a18 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:14.688264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 100/202] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:14.689422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17599e-674f-4e3c-aa81-190a98c1b70e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:14.715191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:14.751606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 103/203] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:14.756377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979cf74-efb5-4d3f-9f77-6c25a2fa9a18 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:14.819881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17599e-674f-4e3c-aa81-190a98c1b70e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:14.833629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:14.869885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:14.870411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:14.870689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:14.870957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:14.871681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9, user.id=6ae273f07eb94c638a0a77866bdb6ff9) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:14.871982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:14.873528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:14.874520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979cf74-efb5-4d3f-9f77-6c25a2fa9a18 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:14.879173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 101/204] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:14 2022] GET /identity/v3/role_assignments?user.id=6ae273f07eb94c638a0a77866bdb6ff9&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:14.879947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:14.917314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0e851-957d-4612-8270-d32e5282dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:14.918788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0e851-957d-4612-8270-d32e5282dc0c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:14.919310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0e851-957d-4612-8270-d32e5282dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:14.919779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0e851-957d-4612-8270-d32e5282dc0c None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:14.921545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0e851-957d-4612-8270-d32e5282dc0c None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:14.923425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0e851-957d-4612-8270-d32e5282dc0c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:14.926166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 104/205] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:14 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:14.934351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0e851-957d-4612-8270-d32e5282dc0c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:15.045243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:15.063576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556601ca-115b-4b53-8234-baebbea414d4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:15.101854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1c868-3ef4-45e2-80fb-877402b7b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:15.102681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1c868-3ef4-45e2-80fb-877402b7b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:15.102961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1c868-3ef4-45e2-80fb-877402b7b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:15.103229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1c868-3ef4-45e2-80fb-877402b7b3e9 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:15.104650 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1c868-3ef4-45e2-80fb-877402b7b3e9 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:15.106113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc1c868-3ef4-45e2-80fb-877402b7b3e9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:15.107901 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 102/206] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:14 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:15.114127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1c868-3ef4-45e2-80fb-877402b7b3e9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:15.196013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0e851-957d-4612-8270-d32e5282dc0c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:15.235292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eac3d-38fc-4b6e-bfc9-c9e819fb37db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:15.235894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eac3d-38fc-4b6e-bfc9-c9e819fb37db None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:15.236188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eac3d-38fc-4b6e-bfc9-c9e819fb37db None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:15.236466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eac3d-38fc-4b6e-bfc9-c9e819fb37db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:15.237190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eac3d-38fc-4b6e-bfc9-c9e819fb37db None admin] RBAC: Adding query filter params (role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9, user.id=6ae273f07eb94c638a0a77866bdb6ff9) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:15.237493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eac3d-38fc-4b6e-bfc9-c9e819fb37db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:15.239064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eac3d-38fc-4b6e-bfc9-c9e819fb37db None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:15.245636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 105/207] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:14 2022] GET /identity/v3/role_assignments?user.id=6ae273f07eb94c638a0a77866bdb6ff9&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:15.274912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1c868-3ef4-45e2-80fb-877402b7b3e9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:15.318154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cacdcd-4d2c-40d8-a047-dc97f5b173d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:15.318810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cacdcd-4d2c-40d8-a047-dc97f5b173d7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:15.319091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cacdcd-4d2c-40d8-a047-dc97f5b173d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:15.319362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cacdcd-4d2c-40d8-a047-dc97f5b173d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:15.320115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cacdcd-4d2c-40d8-a047-dc97f5b173d7 None admin] RBAC: Adding query filter params (role.id=e88008987bf44713a9598a0e5b5ff146, scope.project.id=03aab93361d540d59cc78163f7da6239, user.id=3ed9a17bcc6949d6bda080925888a735) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:15.320456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cacdcd-4d2c-40d8-a047-dc97f5b173d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:15.321924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cacdcd-4d2c-40d8-a047-dc97f5b173d7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:15.329173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 103/208] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:15 2022] GET /identity/v3/role_assignments?user.id=3ed9a17bcc6949d6bda080925888a735&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=e88008987bf44713a9598a0e5b5ff146 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:16.243212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729a8c-de4b-48da-89dc-b8710dbca106 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.243724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729a8c-de4b-48da-89dc-b8710dbca106 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.243724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729a8c-de4b-48da-89dc-b8710dbca106 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:16.245120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 106/209] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:16.250380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f407f64-4848-4a91-835d-eab2f4103f78 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.251192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f407f64-4848-4a91-835d-eab2f4103f78 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.251672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f407f64-4848-4a91-835d-eab2f4103f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:16.274956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4f407f64-4848-4a91-835d-eab2f4103f78 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:16.276494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4f407f64-4848-4a91-835d-eab2f4103f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:16.291793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:16.350002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 104/210] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:16.416806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5247-cd05-413c-aff1-7f1914535942 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.417498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5247-cd05-413c-aff1-7f1914535942 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.417980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c5247-cd05-413c-aff1-7f1914535942 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:16.419769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 107/211] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:16.425331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac63d6-6e88-44a1-8cff-536e01c7688d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.425832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac63d6-6e88-44a1-8cff-536e01c7688d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.426314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac63d6-6e88-44a1-8cff-536e01c7688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:16.447050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-fdac63d6-6e88-44a1-8cff-536e01c7688d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:16.448313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fdac63d6-6e88-44a1-8cff-536e01c7688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:16.518814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 105/212] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:16.628120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5247-cd05-413c-aff1-7f1914535942 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:16.633553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:16.742752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c5247-cd05-413c-aff1-7f1914535942 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:16.778702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7669d-4127-478b-8d7a-5a83490e522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:16.779520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7669d-4127-478b-8d7a-5a83490e522b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.779799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7669d-4127-478b-8d7a-5a83490e522b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.780105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7669d-4127-478b-8d7a-5a83490e522b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:16.792014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a7669d-4127-478b-8d7a-5a83490e522b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-84a7669d-4127-478b-8d7a-5a83490e522b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:16.796975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:16.797839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:16.798636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 108/213] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:16.804727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac63d6-6e88-44a1-8cff-536e01c7688d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:16.817500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7669d-4127-478b-8d7a-5a83490e522b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:16.887811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:16.891181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:16.914630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac63d6-6e88-44a1-8cff-536e01c7688d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:16.930633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7669d-4127-478b-8d7a-5a83490e522b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:16.952886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacddfd-2828-4db4-8a45-35319541b769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:16.953844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacddfd-2828-4db4-8a45-35319541b769 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.954291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacddfd-2828-4db4-8a45-35319541b769 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.954721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacddfd-2828-4db4-8a45-35319541b769 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:16.955773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacddfd-2828-4db4-8a45-35319541b769 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:16.956314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacddfd-2828-4db4-8a45-35319541b769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:16.958534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacddfd-2828-4db4-8a45-35319541b769 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:16.968248 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 106/214] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:16.974176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feeca8-3c1d-4dd7-a3ea-12ea31544b6d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.974675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feeca8-3c1d-4dd7-a3ea-12ea31544b6d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.974962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feeca8-3c1d-4dd7-a3ea-12ea31544b6d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:16.975584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd0756-bd81-43f5-8504-2393675594c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:16.976407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 107/215] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:16.976629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0756-bd81-43f5-8504-2393675594c3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.976629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0756-bd81-43f5-8504-2393675594c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.980304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd0756-bd81-43f5-8504-2393675594c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:16.980419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feeca8-3c1d-4dd7-a3ea-12ea31544b6d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:16.981385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd0756-bd81-43f5-8504-2393675594c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:16.983063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd0756-bd81-43f5-8504-2393675594c3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:16.984991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 109/216] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:16.990102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf930-3d2f-4293-aa68-245faa9f8f3f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:16.990388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf930-3d2f-4293-aa68-245faa9f8f3f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:16.990662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cf930-3d2f-4293-aa68-245faa9f8f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.011111 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-954cf930-3d2f-4293-aa68-245faa9f8f3f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:17.012343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-954cf930-3d2f-4293-aa68-245faa9f8f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:17.082038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 110/217] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:17.083784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cf930-3d2f-4293-aa68-245faa9f8f3f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:17.092256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3feeca8-3c1d-4dd7-a3ea-12ea31544b6d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:17.136741 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e1bbc-c6c1-471f-ad1a-826d94ccb041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:17.137376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1bbc-c6c1-471f-ad1a-826d94ccb041 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.137659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1bbc-c6c1-471f-ad1a-826d94ccb041 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.137930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e1bbc-c6c1-471f-ad1a-826d94ccb041 None admin] PATH_INFO: `/v3/users/c157d7ae14354c0987283eafe467c5a6` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.150581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:17.153285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e1bbc-c6c1-471f-ad1a-826d94ccb041 None admin] RBAC: Authorizing `identity:get_user(user_id=c157d7ae14354c0987283eafe467c5a6)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:17.154780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e1bbc-c6c1-471f-ad1a-826d94ccb041 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:17.156795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 108/218] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:16 2022] GET /identity/v3/users/c157d7ae14354c0987283eafe467c5a6 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:17.162567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e1bbc-c6c1-471f-ad1a-826d94ccb041 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:17.172039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:17.223870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cf930-3d2f-4293-aa68-245faa9f8f3f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:17.271605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba54d2-b4b0-4deb-a63a-9c83ddff7802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:17.272348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba54d2-b4b0-4deb-a63a-9c83ddff7802 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.272596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba54d2-b4b0-4deb-a63a-9c83ddff7802 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.272875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba54d2-b4b0-4deb-a63a-9c83ddff7802 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.273587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba54d2-b4b0-4deb-a63a-9c83ddff7802 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:17.275699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba54d2-b4b0-4deb-a63a-9c83ddff7802 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:17.287436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e1bbc-c6c1-471f-ad1a-826d94ccb041 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:17.307429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 111/219] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:17 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:17.333992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6961f759-dd55-4056-ae9a-8f2fed8d8984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:17.334960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f759-dd55-4056-ae9a-8f2fed8d8984 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.335399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f759-dd55-4056-ae9a-8f2fed8d8984 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.335810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6961f759-dd55-4056-ae9a-8f2fed8d8984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.363478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba54d2-b4b0-4deb-a63a-9c83ddff7802 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:17.415369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:17.418465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961f759-dd55-4056-ae9a-8f2fed8d8984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:17.420737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6961f759-dd55-4056-ae9a-8f2fed8d8984 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:17.489568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba54d2-b4b0-4deb-a63a-9c83ddff7802 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:17.512570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:17.529207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff1710-3f6a-4223-812e-61def1ec59f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:17.529841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1710-3f6a-4223-812e-61def1ec59f5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.532422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1710-3f6a-4223-812e-61def1ec59f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.532422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1710-3f6a-4223-812e-61def1ec59f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.544569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff1710-3f6a-4223-812e-61def1ec59f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-90ff1710-3f6a-4223-812e-61def1ec59f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:17.553607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:17.554524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:17.555307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:17.556327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 109/220] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:17.557866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548b1e1-dbd7-4a08-915d-c5e354c43789 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.558288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548b1e1-dbd7-4a08-915d-c5e354c43789 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.558697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2548b1e1-dbd7-4a08-915d-c5e354c43789 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.560136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 110/221] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:17.560993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548b1e1-dbd7-4a08-915d-c5e354c43789 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:17.562738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 112/222] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:32:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:17.566266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975884-1834-4c0b-b026-8fa2c9b9765e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.566697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975884-1834-4c0b-b026-8fa2c9b9765e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.567080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975884-1834-4c0b-b026-8fa2c9b9765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.590601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3a975884-1834-4c0b-b026-8fa2c9b9765e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:17.592156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3a975884-1834-4c0b-b026-8fa2c9b9765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:17.688310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 113/223] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:17.690239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:17.691055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975884-1834-4c0b-b026-8fa2c9b9765e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:17.695532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2548b1e1-dbd7-4a08-915d-c5e354c43789 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:17.738102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e59b16-b2bb-45da-8fef-9b2bea189258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:17.738864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59b16-b2bb-45da-8fef-9b2bea189258 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.739211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59b16-b2bb-45da-8fef-9b2bea189258 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.739569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e59b16-b2bb-45da-8fef-9b2bea189258 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.740837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e59b16-b2bb-45da-8fef-9b2bea189258 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:17.742459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e59b16-b2bb-45da-8fef-9b2bea189258 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:17.744552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 111/224] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:17 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:17.753176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e59b16-b2bb-45da-8fef-9b2bea189258 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:17.826202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975884-1834-4c0b-b026-8fa2c9b9765e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:17.844573 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:17.867637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e59b16-b2bb-45da-8fef-9b2bea189258 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:17.893788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:17.894455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.894930 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.895202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.895874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:17.896187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:17.897595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:17.905870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:17.906483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:17.906762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:17.907037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:17.907827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] RBAC: Adding query filter params (role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9, user.id=c157d7ae14354c0987283eafe467c5a6) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:17.908131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:17.909606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:17.916448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 114/225] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:17.919204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 112/226] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:17 2022] GET /identity/v3/role_assignments?user.id=c157d7ae14354c0987283eafe467c5a6&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:17.925298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:18.047819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:18.048860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128adc11-bd94-4c6b-aad8-0cce8b7738c2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:18.112451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:18.119698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c9191-d5f5-4bad-bcc2-e1ee9f8af967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:18.120375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c9191-d5f5-4bad-bcc2-e1ee9f8af967 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:18.120710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c9191-d5f5-4bad-bcc2-e1ee9f8af967 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:18.120985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c9191-d5f5-4bad-bcc2-e1ee9f8af967 None admin] PATH_INFO: `/v3/users/6ae273f07eb94c638a0a77866bdb6ff9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:18.126740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c9191-d5f5-4bad-bcc2-e1ee9f8af967 None admin] RBAC: Authorizing `identity:get_user(user_id=6ae273f07eb94c638a0a77866bdb6ff9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:18.128405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c9191-d5f5-4bad-bcc2-e1ee9f8af967 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:18.130537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 115/227] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:17 2022] GET /identity/v3/users/6ae273f07eb94c638a0a77866bdb6ff9 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:18.136543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c9191-d5f5-4bad-bcc2-e1ee9f8af967 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:18.211794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:18.225928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57118730-8146-4c19-8205-dfac6df3f14f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:18.290194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c9191-d5f5-4bad-bcc2-e1ee9f8af967 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:18.299726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88097cd-fa74-4f57-b15a-cde5e8c6db4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:18.301174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88097cd-fa74-4f57-b15a-cde5e8c6db4a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:18.301470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88097cd-fa74-4f57-b15a-cde5e8c6db4a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:18.301847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88097cd-fa74-4f57-b15a-cde5e8c6db4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:18.319591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88097cd-fa74-4f57-b15a-cde5e8c6db4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-e88097cd-fa74-4f57-b15a-cde5e8c6db4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:18.330051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:18.330937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:18.332389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 113/228] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:18.336408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa4f5-8dee-4040-86c2-82cfac2559fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:18.336408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa4f5-8dee-4040-86c2-82cfac2559fb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:18.336408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa4f5-8dee-4040-86c2-82cfac2559fb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:18.336408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34aa4f5-8dee-4040-86c2-82cfac2559fb None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:18.337387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa4f5-8dee-4040-86c2-82cfac2559fb None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:18.338707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34aa4f5-8dee-4040-86c2-82cfac2559fb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:18.340314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88097cd-fa74-4f57-b15a-cde5e8c6db4a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:18.344305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 116/229] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:18 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:18.350593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa4f5-8dee-4040-86c2-82cfac2559fb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:18.493520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:18.511238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88097cd-fa74-4f57-b15a-cde5e8c6db4a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:18.550308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34aa4f5-8dee-4040-86c2-82cfac2559fb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:18.561604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:18.576931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:18.577544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:18.577823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:18.578086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:18.578762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:18.579061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:18.580476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:18.598540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 114/230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:18.604515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:18.617935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6488e9b-cdee-47cc-8748-5f1a75feffd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:18.618602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488e9b-cdee-47cc-8748-5f1a75feffd1 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:18.618887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488e9b-cdee-47cc-8748-5f1a75feffd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:18.619166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6488e9b-cdee-47cc-8748-5f1a75feffd1 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/users/6ae273f07eb94c638a0a77866bdb6ff9/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:18.621270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6488e9b-cdee-47cc-8748-5f1a75feffd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6527faef0be04d66bdf6fed5305c5dc9, user_id=6ae273f07eb94c638a0a77866bdb6ff9, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:18.622863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6488e9b-cdee-47cc-8748-5f1a75feffd1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:18.651749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 117/231] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:18 2022] PUT /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/users/6ae273f07eb94c638a0a77866bdb6ff9/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:18.786749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269975b-2ce2-4185-acd8-b3c95c273fcf None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:18.826695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c383-2fcb-4282-80a5-ce233046194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:18.827703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c383-2fcb-4282-80a5-ce233046194a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:18.828212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c383-2fcb-4282-80a5-ce233046194a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:18.828712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a1c383-2fcb-4282-80a5-ce233046194a None admin] PATH_INFO: `/v3/users/6ae273f07eb94c638a0a77866bdb6ff9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:18.830189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1c383-2fcb-4282-80a5-ce233046194a None admin] RBAC: Authorizing `identity:get_user(user_id=6ae273f07eb94c638a0a77866bdb6ff9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:18.832608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a1c383-2fcb-4282-80a5-ce233046194a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:18.834645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 115/232] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:18 2022] GET /identity/v3/users/6ae273f07eb94c638a0a77866bdb6ff9 => generated 283 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:18.840481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6488e9b-cdee-47cc-8748-5f1a75feffd1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:18.949485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6488e9b-cdee-47cc-8748-5f1a75feffd1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:19.000943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23a71f-5777-448e-8bd4-a82072411a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:19.001957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a71f-5777-448e-8bd4-a82072411a68 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:19.002464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a71f-5777-448e-8bd4-a82072411a68 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:19.002968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23a71f-5777-448e-8bd4-a82072411a68 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:19.004902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23a71f-5777-448e-8bd4-a82072411a68 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:19.006655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23a71f-5777-448e-8bd4-a82072411a68 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:19.008605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 118/233] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:18 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:19.014232 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c383-2fcb-4282-80a5-ce233046194a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:19.046395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:19.136650 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a1c383-2fcb-4282-80a5-ce233046194a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:19.184908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8a311-5abd-4bbb-8be2-b98a43fd8750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:19.185600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a311-5abd-4bbb-8be2-b98a43fd8750 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:19.185883 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a311-5abd-4bbb-8be2-b98a43fd8750 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:19.186160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a311-5abd-4bbb-8be2-b98a43fd8750 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/users/6ae273f07eb94c638a0a77866bdb6ff9/roles/7f637775fa4c48a194ebb4513effa6b9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:19.188491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8a311-5abd-4bbb-8be2-b98a43fd8750 None admin] RBAC: Authorizing `identity:create_grant(project_id=6527faef0be04d66bdf6fed5305c5dc9, user_id=6ae273f07eb94c638a0a77866bdb6ff9, role_id=7f637775fa4c48a194ebb4513effa6b9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:19.189952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8a311-5abd-4bbb-8be2-b98a43fd8750 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:19.224459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 116/234] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:19 2022] PUT /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/users/6ae273f07eb94c638a0a77866bdb6ff9/roles/7f637775fa4c48a194ebb4513effa6b9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:19.823371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862602e-a1c6-42fc-874b-fb86dc21e319 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:19.823878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862602e-a1c6-42fc-874b-fb86dc21e319 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:19.823950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862602e-a1c6-42fc-874b-fb86dc21e319 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:19.825558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 119/235] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:19.831240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f22cc-f74d-493d-abed-aa3f1e4516b5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:19.831656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f22cc-f74d-493d-abed-aa3f1e4516b5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:19.831831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f22cc-f74d-493d-abed-aa3f1e4516b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:19.833953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820be8fc-a8bc-4476-b82a-22fe6513f7b7 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:19.834230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820be8fc-a8bc-4476-b82a-22fe6513f7b7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:19.834505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820be8fc-a8bc-4476-b82a-22fe6513f7b7 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:19.835929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 120/236] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:19.843480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a2013-eba8-427d-9b99-2539f3de0df8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:19.843759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a2013-eba8-427d-9b99-2539f3de0df8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:19.844032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a2013-eba8-427d-9b99-2539f3de0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:19.871464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8a6f22cc-f74d-493d-abed-aa3f1e4516b5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:19.873096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0c5a2013-eba8-427d-9b99-2539f3de0df8 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:19.874256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0c5a2013-eba8-427d-9b99-2539f3de0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:19.876681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8a6f22cc-f74d-493d-abed-aa3f1e4516b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:19.917367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:19.967710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 121/237] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:20.006432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 117/238] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:20.293872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb44e2-f138-4a9b-8567-dcc48a286efc None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:20.294075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb44e2-f138-4a9b-8567-dcc48a286efc None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:20.294355 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb44e2-f138-4a9b-8567-dcc48a286efc None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:20.296009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 122/239] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:20.301460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef51cb-1dab-4cc8-85b6-855c71ca4cbf None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:20.301750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef51cb-1dab-4cc8-85b6-855c71ca4cbf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:20.302023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef51cb-1dab-4cc8-85b6-855c71ca4cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:20.329093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a5ef51cb-1dab-4cc8-85b6-855c71ca4cbf None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:20.330965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a5ef51cb-1dab-4cc8-85b6-855c71ca4cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:20.339497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:20.364979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb44e2-f138-4a9b-8567-dcc48a286efc None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:20.415574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 118/240] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:20.421016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef51cb-1dab-4cc8-85b6-855c71ca4cbf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:20.496358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb44e2-f138-4a9b-8567-dcc48a286efc None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:20.536640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8b8d7-bb52-4f24-8f2d-5fa88fde6b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:20.537418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b8d7-bb52-4f24-8f2d-5fa88fde6b1c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:20.537699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b8d7-bb52-4f24-8f2d-5fa88fde6b1c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:20.537972 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b8d7-bb52-4f24-8f2d-5fa88fde6b1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:20.539333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8b8d7-bb52-4f24-8f2d-5fa88fde6b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:20.541313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8b8d7-bb52-4f24-8f2d-5fa88fde6b1c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:20.543290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 123/241] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:20.549306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8b8d7-bb52-4f24-8f2d-5fa88fde6b1c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:20.586077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:20.663167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef51cb-1dab-4cc8-85b6-855c71ca4cbf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:20.663579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8b8d7-bb52-4f24-8f2d-5fa88fde6b1c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:20.699840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3d506-9e76-4355-aafa-11bb3bc2812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:20.700827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3d506-9e76-4355-aafa-11bb3bc2812c None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:20.701439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3d506-9e76-4355-aafa-11bb3bc2812c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:20.701900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a3d506-9e76-4355-aafa-11bb3bc2812c None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:20.702859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3d506-9e76-4355-aafa-11bb3bc2812c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:20.704659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a3d506-9e76-4355-aafa-11bb3bc2812c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:20.730543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 124/242] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:20 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:20.731699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3d506-9e76-4355-aafa-11bb3bc2812c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:20.737529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b7542-7474-4272-ae6c-1e1c3bb1f8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:20.738499 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7542-7474-4272-ae6c-1e1c3bb1f8ac None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:20.738993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7542-7474-4272-ae6c-1e1c3bb1f8ac None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:20.739536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34b7542-7474-4272-ae6c-1e1c3bb1f8ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:20.753888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34b7542-7474-4272-ae6c-1e1c3bb1f8ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-d34b7542-7474-4272-ae6c-1e1c3bb1f8ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:20.760699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:20.761672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:20.762470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:20.765681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 119/243] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:20.772497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b7542-7474-4272-ae6c-1e1c3bb1f8ac None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:20.776945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:20.912941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:20.935471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a3d506-9e76-4355-aafa-11bb3bc2812c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:20.983176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb01b1a-32fe-476f-863c-18b7d6217f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:20.983673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34b7542-7474-4272-ae6c-1e1c3bb1f8ac None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:20.986861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01b1a-32fe-476f-863c-18b7d6217f07 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:20.987321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01b1a-32fe-476f-863c-18b7d6217f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:20.987843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb01b1a-32fe-476f-863c-18b7d6217f07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:20.999009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb01b1a-32fe-476f-863c-18b7d6217f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2fb01b1a-32fe-476f-863c-18b7d6217f07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:21.006189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:21.007173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:21.007943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:21.010547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 125/244] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:21.016507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb01b1a-32fe-476f-863c-18b7d6217f07 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.027493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9ee36-24ec-499b-8c9f-2677d950f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:21.028157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9ee36-24ec-499b-8c9f-2677d950f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.028461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9ee36-24ec-499b-8c9f-2677d950f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.028728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9ee36-24ec-499b-8c9f-2677d950f3d1 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.029459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9ee36-24ec-499b-8c9f-2677d950f3d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:21.029760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9ee36-24ec-499b-8c9f-2677d950f3d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:21.031466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9ee36-24ec-499b-8c9f-2677d950f3d1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:21.041179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 120/245] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:21.042396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acd910-9910-4760-85ef-8a5147df4887 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.042707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acd910-9910-4760-85ef-8a5147df4887 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.042978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acd910-9910-4760-85ef-8a5147df4887 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.044207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 121/246] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:21.049669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651b01a-86d0-46aa-812b-44617d6f2ab3 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.049946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651b01a-86d0-46aa-812b-44617d6f2ab3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.050214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651b01a-86d0-46aa-812b-44617d6f2ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.071107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5651b01a-86d0-46aa-812b-44617d6f2ab3 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:21.072318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5651b01a-86d0-46aa-812b-44617d6f2ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:21.153535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb01b1a-32fe-476f-863c-18b7d6217f07 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:21.156871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:21.167655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 122/247] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:21.168865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651b01a-86d0-46aa-812b-44617d6f2ab3 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.205510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:21.206888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.206888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.206888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.207588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:21.207895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:21.210039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:21.222213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 126/248] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:21.228803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.246612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:21.296073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651b01a-86d0-46aa-812b-44617d6f2ab3 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:21.346249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5569bad-e91f-413e-84c9-5feea769e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:21.346684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5569bad-e91f-413e-84c9-5feea769e444 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.347058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5569bad-e91f-413e-84c9-5feea769e444 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.347428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5569bad-e91f-413e-84c9-5feea769e444 None admin] PATH_INFO: `/v3/users/0985a2e21d954d5cb22e9f1ae9349081` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.357307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be735a-0eae-4f53-b91c-2c0cea3b2ae4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:21.365797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5569bad-e91f-413e-84c9-5feea769e444 None admin] RBAC: Authorizing `identity:get_user(user_id=0985a2e21d954d5cb22e9f1ae9349081)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:21.367876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5569bad-e91f-413e-84c9-5feea769e444 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:21.370399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 123/249] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:21 2022] GET /identity/v3/users/0985a2e21d954d5cb22e9f1ae9349081 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:21.375894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5569bad-e91f-413e-84c9-5feea769e444 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.398660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb0480-d259-4e47-a12b-59876cf286f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:21.399627 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb0480-d259-4e47-a12b-59876cf286f3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.400085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb0480-d259-4e47-a12b-59876cf286f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.400554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb0480-d259-4e47-a12b-59876cf286f3 None admin] PATH_INFO: `/v3/users/c157d7ae14354c0987283eafe467c5a6` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.401934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb0480-d259-4e47-a12b-59876cf286f3 None admin] RBAC: Authorizing `identity:get_user(user_id=c157d7ae14354c0987283eafe467c5a6)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:21.403559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb0480-d259-4e47-a12b-59876cf286f3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:21.405728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 127/250] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:21 2022] GET /identity/v3/users/c157d7ae14354c0987283eafe467c5a6 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:21.411671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb0480-d259-4e47-a12b-59876cf286f3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.436018 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:21.488775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5569bad-e91f-413e-84c9-5feea769e444 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:21.526847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920148d2-f35b-4c2b-aa8c-ffabadd25c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:21.527565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920148d2-f35b-4c2b-aa8c-ffabadd25c9b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.527908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920148d2-f35b-4c2b-aa8c-ffabadd25c9b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.528269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920148d2-f35b-4c2b-aa8c-ffabadd25c9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.529242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:21.560075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb0480-d259-4e47-a12b-59876cf286f3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:21.608197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920148d2-f35b-4c2b-aa8c-ffabadd25c9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:21.608197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920148d2-f35b-4c2b-aa8c-ffabadd25c9b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:21.620781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b4686-b716-4507-91f2-e38880814aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:21.621723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4686-b716-4507-91f2-e38880814aba None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.622201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4686-b716-4507-91f2-e38880814aba None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.622691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b4686-b716-4507-91f2-e38880814aba None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.624808 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b4686-b716-4507-91f2-e38880814aba None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:21.627220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b4686-b716-4507-91f2-e38880814aba None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:21.629775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 128/251] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:21 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:21.630905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b4686-b716-4507-91f2-e38880814aba None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.657176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:21.714525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 124/252] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 09:32:21.715269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920148d2-f35b-4c2b-aa8c-ffabadd25c9b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.762223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b4686-b716-4507-91f2-e38880814aba None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:21.804933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690c171-7ec7-4a1e-be7f-b1e1d1281057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:21.805574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690c171-7ec7-4a1e-be7f-b1e1d1281057 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.805855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690c171-7ec7-4a1e-be7f-b1e1d1281057 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.806129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690c171-7ec7-4a1e-be7f-b1e1d1281057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.821977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690c171-7ec7-4a1e-be7f-b1e1d1281057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4690c171-7ec7-4a1e-be7f-b1e1d1281057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:21.829853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:21.830748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:21.831530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 129/253] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:32:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:21.832188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690c171-7ec7-4a1e-be7f-b1e1d1281057 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.840883 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920148d2-f35b-4c2b-aa8c-ffabadd25c9b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:21.845288 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:21.879811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b111244-1ed1-4a2c-a84f-bc52d2cee561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:21.880790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111244-1ed1-4a2c-a84f-bc52d2cee561 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.881209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111244-1ed1-4a2c-a84f-bc52d2cee561 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.881621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111244-1ed1-4a2c-a84f-bc52d2cee561 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/users/c157d7ae14354c0987283eafe467c5a6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.883838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b111244-1ed1-4a2c-a84f-bc52d2cee561 None admin] RBAC: Authorizing `identity:create_grant(project_id=6527faef0be04d66bdf6fed5305c5dc9, user_id=c157d7ae14354c0987283eafe467c5a6, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:21.885715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b111244-1ed1-4a2c-a84f-bc52d2cee561 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:21.901801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 125/254] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:21 2022] PUT /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/users/c157d7ae14354c0987283eafe467c5a6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:21.903913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c08673-180b-41cf-abce-0571bea6d3f4 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:21.904407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c08673-180b-41cf-abce-0571bea6d3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:21.905180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c08673-180b-41cf-abce-0571bea6d3f4 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:21.908628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 126/255] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:21.909959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c08673-180b-41cf-abce-0571bea6d3f4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:21.929645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:21.977859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690c171-7ec7-4a1e-be7f-b1e1d1281057 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:22.027744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b721ba-1563-496f-96d5-b7efa6984ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:22.028411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b721ba-1563-496f-96d5-b7efa6984ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:22.028692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b721ba-1563-496f-96d5-b7efa6984ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:22.029217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b721ba-1563-496f-96d5-b7efa6984ba1 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:22.031081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b721ba-1563-496f-96d5-b7efa6984ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:22.033442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b721ba-1563-496f-96d5-b7efa6984ba1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:22.040279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 130/256] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:21 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:22.042048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982f1f-ae3b-43ec-aeac-a37f7c3fbc46 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:22.044460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982f1f-ae3b-43ec-aeac-a37f7c3fbc46 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:22.046476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39982f1f-ae3b-43ec-aeac-a37f7c3fbc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:22.066816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c08673-180b-41cf-abce-0571bea6d3f4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:22.067927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-39982f1f-ae3b-43ec-aeac-a37f7c3fbc46 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:22.069426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-39982f1f-ae3b-43ec-aeac-a37f7c3fbc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:22.111161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:22.111792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:22.112070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:22.112366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:22.113051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:22.113355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:22.114776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:22.126298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 127/257] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:22.127222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:22.177214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 131/258] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:22.178092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39982f1f-ae3b-43ec-aeac-a37f7c3fbc46 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:22.181335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:22.225387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:22.256150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba295a87-b0f2-42e5-85a7-b1fcb916ee5a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:22.282947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39982f1f-ae3b-43ec-aeac-a37f7c3fbc46 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:22.295359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:22.296358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:22.296888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:22.298305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:22.299243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] RBAC: Adding query filter params (role.id=e88008987bf44713a9598a0e5b5ff146, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9, user.id=0985a2e21d954d5cb22e9f1ae9349081) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:22.299750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:22.301693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:22.308450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 128/259] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:22 2022] GET /identity/v3/role_assignments?user.id=0985a2e21d954d5cb22e9f1ae9349081&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=e88008987bf44713a9598a0e5b5ff146 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:22.327661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd050ca8-69ff-4ce6-975f-c0bbbef15e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:22.328333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050ca8-69ff-4ce6-975f-c0bbbef15e0e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:22.329282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050ca8-69ff-4ce6-975f-c0bbbef15e0e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:22.329556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd050ca8-69ff-4ce6-975f-c0bbbef15e0e None admin] PATH_INFO: `/v3/users/6ae273f07eb94c638a0a77866bdb6ff9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:22.330795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd050ca8-69ff-4ce6-975f-c0bbbef15e0e None admin] RBAC: Authorizing `identity:get_user(user_id=6ae273f07eb94c638a0a77866bdb6ff9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:22.332285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd050ca8-69ff-4ce6-975f-c0bbbef15e0e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:22.333865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 132/260] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:22 2022] GET /identity/v3/users/6ae273f07eb94c638a0a77866bdb6ff9 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:22.340154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:22.508080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc87840-873d-4dfc-99fd-a81f064907ff None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:22.550036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05133de-f5d4-4160-9e14-79172f44a8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:22.550655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05133de-f5d4-4160-9e14-79172f44a8a9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:22.550941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05133de-f5d4-4160-9e14-79172f44a8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:22.551217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05133de-f5d4-4160-9e14-79172f44a8a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:22.566990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:22.589681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd050ca8-69ff-4ce6-975f-c0bbbef15e0e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:22.654144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05133de-f5d4-4160-9e14-79172f44a8a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:22.655999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05133de-f5d4-4160-9e14-79172f44a8a9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:22.801381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:22.868058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd050ca8-69ff-4ce6-975f-c0bbbef15e0e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:22.894038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 129/261] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:22.899472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05133de-f5d4-4160-9e14-79172f44a8a9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:22.946663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f869-537b-4289-ab42-6450c83dca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:22.947316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f869-537b-4289-ab42-6450c83dca0c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:22.947598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f869-537b-4289-ab42-6450c83dca0c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:22.947872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f869-537b-4289-ab42-6450c83dca0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:22.966433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c1f869-537b-4289-ab42-6450c83dca0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-58c1f869-537b-4289-ab42-6450c83dca0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:22.974623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:22.975585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:22.976383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:22.979195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 133/262] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 390 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:22.992703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:22.995443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f869-537b-4289-ab42-6450c83dca0c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:23.079955 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05133de-f5d4-4160-9e14-79172f44a8a9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:23.111969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f869-537b-4289-ab42-6450c83dca0c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:23.117493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604f1a-9a48-467d-983b-34976ff8f8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:23.118136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604f1a-9a48-467d-983b-34976ff8f8c6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:23.118470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604f1a-9a48-467d-983b-34976ff8f8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:23.118750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85604f1a-9a48-467d-983b-34976ff8f8c6 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:23.119894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85604f1a-9a48-467d-983b-34976ff8f8c6 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:23.121411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85604f1a-9a48-467d-983b-34976ff8f8c6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:23.123358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 130/263] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:22 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:23.130063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604f1a-9a48-467d-983b-34976ff8f8c6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:23.148625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:23.157168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:23.157905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:23.158298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:23.158717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:23.161337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:23.161746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:23.163535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:23.186088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 134/264] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:23.197144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:23.355986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85604f1a-9a48-467d-983b-34976ff8f8c6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:23.366924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:23.432890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:23.433518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:23.433803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:23.434076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:23.434821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9, user.id=6ae273f07eb94c638a0a77866bdb6ff9) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:23.435137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:23.436683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:23.447551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 131/265] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:23 2022] GET /identity/v3/role_assignments?user.id=6ae273f07eb94c638a0a77866bdb6ff9&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:23.449761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15476086-1096-4461-b7e4-7f0db5fd3063 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:23.516128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cab21f-702a-4104-9ed9-b009e57989b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:23.517384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cab21f-702a-4104-9ed9-b009e57989b5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:23.517868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cab21f-702a-4104-9ed9-b009e57989b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:23.518362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cab21f-702a-4104-9ed9-b009e57989b5 None admin] PATH_INFO: `/v3/users/6ae273f07eb94c638a0a77866bdb6ff9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:23.524936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cab21f-702a-4104-9ed9-b009e57989b5 None admin] RBAC: Authorizing `identity:get_user(user_id=6ae273f07eb94c638a0a77866bdb6ff9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:23.526719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cab21f-702a-4104-9ed9-b009e57989b5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:23.529001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 135/266] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:23 2022] GET /identity/v3/users/6ae273f07eb94c638a0a77866bdb6ff9 => generated 283 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:23.534979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:23.698611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cee4d14-1257-4e8e-a5ae-20e30563bd82 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:23.758859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991c829-2732-46b5-86f5-ea2f981795cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:23.759494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991c829-2732-46b5-86f5-ea2f981795cf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:23.759775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991c829-2732-46b5-86f5-ea2f981795cf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:23.760120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991c829-2732-46b5-86f5-ea2f981795cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:23.804860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:23.841279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991c829-2732-46b5-86f5-ea2f981795cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:23.843144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991c829-2732-46b5-86f5-ea2f981795cf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:23.948002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 132/267] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:23.954440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cab21f-702a-4104-9ed9-b009e57989b5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:24.045518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1404-e232-4553-b15e-067ab5a769c1 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.046187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1404-e232-4553-b15e-067ab5a769c1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.046679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9c1404-e232-4553-b15e-067ab5a769c1 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.048228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 133/268] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:24.053438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2d31f-9411-4ab5-ab5e-de513efe1c41 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.054525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2d31f-9411-4ab5-ab5e-de513efe1c41 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.054998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2d31f-9411-4ab5-ab5e-de513efe1c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.066242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:24.081648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d3d2d31f-9411-4ab5-ab5e-de513efe1c41 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:24.083497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d3d2d31f-9411-4ab5-ab5e-de513efe1c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:24.112807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cab21f-702a-4104-9ed9-b009e57989b5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:24.152746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837877a-cc52-4172-9b56-5c678387f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:24.153385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837877a-cc52-4172-9b56-5c678387f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.153673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837877a-cc52-4172-9b56-5c678387f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.153950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837877a-cc52-4172-9b56-5c678387f4b3 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.155091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837877a-cc52-4172-9b56-5c678387f4b3 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:24.157077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837877a-cc52-4172-9b56-5c678387f4b3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:24.159586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 136/269] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:23 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:24.164208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:24.165084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f9e11-0ec1-4cd7-bc50-122e0b9e8e26 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.165547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f9e11-0ec1-4cd7-bc50-122e0b9e8e26 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.165687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f9e11-0ec1-4cd7-bc50-122e0b9e8e26 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.167004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 137/270] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:24.167731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f9e11-0ec1-4cd7-bc50-122e0b9e8e26 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:24.170709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 134/271] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:24.186511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b046-4a62-4494-b894-57874b7181a6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.187211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b046-4a62-4494-b894-57874b7181a6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.187677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b046-4a62-4494-b894-57874b7181a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.218619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e465b046-4a62-4494-b894-57874b7181a6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:24.219711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e465b046-4a62-4494-b894-57874b7181a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:24.320884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 135/272] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:24.365107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f9e11-0ec1-4cd7-bc50-122e0b9e8e26 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:24.400679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:24.411703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:24.412342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.412630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.412905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.413640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] RBAC: Adding query filter params (role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9, user.id=6ae273f07eb94c638a0a77866bdb6ff9) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:24.413947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:24.415414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:24.425410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 138/273] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:24 2022] GET /identity/v3/role_assignments?user.id=6ae273f07eb94c638a0a77866bdb6ff9&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:24.538987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465b046-4a62-4494-b894-57874b7181a6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:24.631223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:24.649358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465b046-4a62-4494-b894-57874b7181a6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:24.692033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:24.700044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710723-2ab4-4f44-80da-97e060356cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:24.701055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710723-2ab4-4f44-80da-97e060356cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.701578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710723-2ab4-4f44-80da-97e060356cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.702544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b710723-2ab4-4f44-80da-97e060356cb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.704404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b710723-2ab4-4f44-80da-97e060356cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:24.706184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b710723-2ab4-4f44-80da-97e060356cb7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:24.708433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 136/274] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:24.714835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710723-2ab4-4f44-80da-97e060356cb7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:24.775179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37a4f4-d0e8-4a89-aabc-d737fa7cdbd2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:24.825308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02598c5-dd59-4ec6-84a2-0251bc533751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:24.825989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02598c5-dd59-4ec6-84a2-0251bc533751 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.826338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02598c5-dd59-4ec6-84a2-0251bc533751 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.826679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02598c5-dd59-4ec6-84a2-0251bc533751 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.844119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02598c5-dd59-4ec6-84a2-0251bc533751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-a02598c5-dd59-4ec6-84a2-0251bc533751 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:24.851245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:24.852155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:24.852968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 139/275] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:24.863829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02598c5-dd59-4ec6-84a2-0251bc533751 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:24.868764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b710723-2ab4-4f44-80da-97e060356cb7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:24.910833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db37bb-f74d-4269-a3a2-c4747976867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:24.911446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db37bb-f74d-4269-a3a2-c4747976867b None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.911734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db37bb-f74d-4269-a3a2-c4747976867b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.912009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db37bb-f74d-4269-a3a2-c4747976867b None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.912694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db37bb-f74d-4269-a3a2-c4747976867b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:24.914137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db37bb-f74d-4269-a3a2-c4747976867b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:24.934644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:24.944227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 137/276] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:24 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:24.944227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055899-dd46-44e3-a331-f1da52084adb None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.944227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055899-dd46-44e3-a331-f1da52084adb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.944227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77055899-dd46-44e3-a331-f1da52084adb None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.944227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 138/277] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:24.947220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad017-c458-4fe5-8fea-ee5452308659 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:24.947540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad017-c458-4fe5-8fea-ee5452308659 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:24.947795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ad017-c458-4fe5-8fea-ee5452308659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:24.969960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f63ad017-c458-4fe5-8fea-ee5452308659 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:24.971201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f63ad017-c458-4fe5-8fea-ee5452308659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:25.016450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02598c5-dd59-4ec6-84a2-0251bc533751 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:25.039260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:25.059581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2b590-d0e1-4b8b-be1f-ed4c878e5779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:25.060330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b590-d0e1-4b8b-be1f-ed4c878e5779 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:25.060623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b590-d0e1-4b8b-be1f-ed4c878e5779 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:25.060902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2b590-d0e1-4b8b-be1f-ed4c878e5779 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:25.062065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2b590-d0e1-4b8b-be1f-ed4c878e5779 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:25.062065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2b590-d0e1-4b8b-be1f-ed4c878e5779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:25.063565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a2b590-d0e1-4b8b-be1f-ed4c878e5779 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:25.068128 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 139/278] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:25.078492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 140/279] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:25.085362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ad017-c458-4fe5-8fea-ee5452308659 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:25.161526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f576e-6dcd-427b-b518-d98326b6ed4c None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:25.161810 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f576e-6dcd-427b-b518-d98326b6ed4c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:25.162071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f576e-6dcd-427b-b518-d98326b6ed4c None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:25.163561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 141/280] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:25.172597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5236908-ed5f-4e6b-b161-b8fd67df3b24 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:25.172886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5236908-ed5f-4e6b-b161-b8fd67df3b24 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:25.173218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5236908-ed5f-4e6b-b161-b8fd67df3b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:25.193792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b5236908-ed5f-4e6b-b161-b8fd67df3b24 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:25.194961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b5236908-ed5f-4e6b-b161-b8fd67df3b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:25.204601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ad017-c458-4fe5-8fea-ee5452308659 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:25.246411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c4290-bcba-462f-ad4a-bc1a5d4c9f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:25.247057 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4290-bcba-462f-ad4a-bc1a5d4c9f15 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:25.247338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4290-bcba-462f-ad4a-bc1a5d4c9f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:25.247615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4290-bcba-462f-ad4a-bc1a5d4c9f15 None admin] PATH_INFO: `/v3/users/12bd6ba547f64f939cfc3a34b0f2a989` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:25.266709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4290-bcba-462f-ad4a-bc1a5d4c9f15 None admin] RBAC: Authorizing `identity:get_user(user_id=12bd6ba547f64f939cfc3a34b0f2a989)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:25.268218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4290-bcba-462f-ad4a-bc1a5d4c9f15 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:25.269898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 140/281] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:25 2022] GET /identity/v3/users/12bd6ba547f64f939cfc3a34b0f2a989 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:25.276435 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c4290-bcba-462f-ad4a-bc1a5d4c9f15 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:25.284586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 142/282] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:25.331087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:25.361338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5236908-ed5f-4e6b-b161-b8fd67df3b24 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:25.397801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c4290-bcba-462f-ad4a-bc1a5d4c9f15 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:25.433301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:25.434123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:25.434409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:25.434693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:25.435420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] RBAC: Adding query filter params (role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, user.id=12bd6ba547f64f939cfc3a34b0f2a989, scope.system=all) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:25.436340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:25.437930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:25.443500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 141/283] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 31 09:32:25 2022] GET /identity/v3/role_assignments?user.id=12bd6ba547f64f939cfc3a34b0f2a989&scope.system=all&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:25.445476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:25.516738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5236908-ed5f-4e6b-b161-b8fd67df3b24 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:25.567011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965cec-2d9b-484e-84f8-4e012ae2dd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:25.567672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965cec-2d9b-484e-84f8-4e012ae2dd32 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:25.567956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965cec-2d9b-484e-84f8-4e012ae2dd32 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:25.568251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43965cec-2d9b-484e-84f8-4e012ae2dd32 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:25.587465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43965cec-2d9b-484e-84f8-4e012ae2dd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-43965cec-2d9b-484e-84f8-4e012ae2dd32 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:25.592605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:25.593652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:25.594456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 143/284] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:25.601462 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:25.603621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965cec-2d9b-484e-84f8-4e012ae2dd32 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:25.739900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43965cec-2d9b-484e-84f8-4e012ae2dd32 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:25.753906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:25.767692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87edf0-bb2c-4d6b-b30b-f383e249c305 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:25.780573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:25.808544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e86aac-add3-432b-8f5c-0a3f0fda36eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:25.809137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e86aac-add3-432b-8f5c-0a3f0fda36eb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:25.809419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e86aac-add3-432b-8f5c-0a3f0fda36eb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:25.809691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e86aac-add3-432b-8f5c-0a3f0fda36eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:25.828233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e86aac-add3-432b-8f5c-0a3f0fda36eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:25.834109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:25.834716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:25.835002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:25.835273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:25.835952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:25.836278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:25.837728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e3e86aac-add3-432b-8f5c-0a3f0fda36eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:25.841055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:25.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:25.843762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:25.844864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 144/285] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:25.850628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e86aac-add3-432b-8f5c-0a3f0fda36eb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:25.855918 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 142/286] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:25.858950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:25.994083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e86aac-add3-432b-8f5c-0a3f0fda36eb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:26.031463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:26.032443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:26.032923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:26.033411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:26.034379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:26.034897 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:26.036534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:26.046019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 145/287] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:26.051650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:26.057302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87b503-b0bc-405f-8647-b5daf636d36d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:26.082971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:26.140278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03022a-4352-40de-8800-f5318530c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:26.140977 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03022a-4352-40de-8800-f5318530c252 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:26.141240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03022a-4352-40de-8800-f5318530c252 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:26.141517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03022a-4352-40de-8800-f5318530c252 None admin] PATH_INFO: `/v3/users/c157d7ae14354c0987283eafe467c5a6` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:26.142703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03022a-4352-40de-8800-f5318530c252 None admin] RBAC: Authorizing `identity:get_user(user_id=c157d7ae14354c0987283eafe467c5a6)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:26.144159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03022a-4352-40de-8800-f5318530c252 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:26.145779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 143/288] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:25 2022] GET /identity/v3/users/c157d7ae14354c0987283eafe467c5a6 => generated 297 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:26.157235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03022a-4352-40de-8800-f5318530c252 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:26.166311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c909e93-e65f-4c9b-98ac-4cd5bf6cc7ed None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:26.202877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f079e43-13af-4f31-8e9f-d8e716a6ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:26.204052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079e43-13af-4f31-8e9f-d8e716a6ffb1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:26.204577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079e43-13af-4f31-8e9f-d8e716a6ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:26.205047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f079e43-13af-4f31-8e9f-d8e716a6ffb1 None admin] PATH_INFO: `/v3/users/0985a2e21d954d5cb22e9f1ae9349081` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:26.206433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f079e43-13af-4f31-8e9f-d8e716a6ffb1 None admin] RBAC: Authorizing `identity:get_user(user_id=0985a2e21d954d5cb22e9f1ae9349081)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:26.208401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f079e43-13af-4f31-8e9f-d8e716a6ffb1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:26.210467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 146/289] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:26 2022] GET /identity/v3/users/0985a2e21d954d5cb22e9f1ae9349081 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:26.215957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f079e43-13af-4f31-8e9f-d8e716a6ffb1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:26.266484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:26.343342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:26.349158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03022a-4352-40de-8800-f5318530c252 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:26.353293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f079e43-13af-4f31-8e9f-d8e716a6ffb1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:26.413048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815129a-ae4d-4c31-a757-44f0bd92ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:26.413998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815129a-ae4d-4c31-a757-44f0bd92ea36 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:26.414469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815129a-ae4d-4c31-a757-44f0bd92ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:26.414929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815129a-ae4d-4c31-a757-44f0bd92ea36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:26.432692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d96ce-e884-4adf-8175-fd87496cbfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:26.433699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d96ce-e884-4adf-8175-fd87496cbfc3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:26.434175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d96ce-e884-4adf-8175-fd87496cbfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:26.434646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d96ce-e884-4adf-8175-fd87496cbfc3 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:26.436608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d96ce-e884-4adf-8175-fd87496cbfc3 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:26.439490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d96ce-e884-4adf-8175-fd87496cbfc3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:26.442359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 147/290] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:26 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:26.447522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d96ce-e884-4adf-8175-fd87496cbfc3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:26.534973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815129a-ae4d-4c31-a757-44f0bd92ea36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:26.537503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815129a-ae4d-4c31-a757-44f0bd92ea36 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:26.596084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:26.636540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d96ce-e884-4adf-8175-fd87496cbfc3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:26.705072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adfa8-3a87-45a8-aa33-c7dcdcc3b26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:26.705657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adfa8-3a87-45a8-aa33-c7dcdcc3b26e None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:26.705946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adfa8-3a87-45a8-aa33-c7dcdcc3b26e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:26.706223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0adfa8-3a87-45a8-aa33-c7dcdcc3b26e None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/users/0985a2e21d954d5cb22e9f1ae9349081/roles/e88008987bf44713a9598a0e5b5ff146` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:26.709492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 144/291] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:26.710483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adfa8-3a87-45a8-aa33-c7dcdcc3b26e None admin] RBAC: Authorizing `identity:create_grant(project_id=6527faef0be04d66bdf6fed5305c5dc9, user_id=0985a2e21d954d5cb22e9f1ae9349081, role_id=e88008987bf44713a9598a0e5b5ff146)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:26.711958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0adfa8-3a87-45a8-aa33-c7dcdcc3b26e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:26.720483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815129a-ae4d-4c31-a757-44f0bd92ea36 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:26.739717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 148/292] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:32:26 2022] PUT /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/users/0985a2e21d954d5cb22e9f1ae9349081/roles/e88008987bf44713a9598a0e5b5ff146 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:32:26.881359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815129a-ae4d-4c31-a757-44f0bd92ea36 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:26.936859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2de6c-5614-4cbe-af71-c61ce0032059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:26.937860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2de6c-5614-4cbe-af71-c61ce0032059 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:26.938354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2de6c-5614-4cbe-af71-c61ce0032059 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:26.938801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2de6c-5614-4cbe-af71-c61ce0032059 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:26.940132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2de6c-5614-4cbe-af71-c61ce0032059 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:26.941775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2de6c-5614-4cbe-af71-c61ce0032059 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:26.943609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 145/293] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:26 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:26.949740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adfa8-3a87-45a8-aa33-c7dcdcc3b26e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:26.985085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:27.071984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0adfa8-3a87-45a8-aa33-c7dcdcc3b26e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:27.112900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e515438-c148-4491-ba0e-503243ceea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:27.114293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e515438-c148-4491-ba0e-503243ceea13 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:27.114764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e515438-c148-4491-ba0e-503243ceea13 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:27.115208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e515438-c148-4491-ba0e-503243ceea13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:27.116116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e515438-c148-4491-ba0e-503243ceea13 None admin] RBAC: Adding query filter params (role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9, user.id=c157d7ae14354c0987283eafe467c5a6) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:27.116619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e515438-c148-4491-ba0e-503243ceea13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:27.118411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e515438-c148-4491-ba0e-503243ceea13 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:27.128827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 149/294] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:26 2022] GET /identity/v3/role_assignments?user.id=c157d7ae14354c0987283eafe467c5a6&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:27.372817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ac4a-8b99-4e04-a792-90972a1deb28 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:27.373702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ac4a-8b99-4e04-a792-90972a1deb28 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:27.374159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2ac4a-8b99-4e04-a792-90972a1deb28 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:27.375700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 146/295] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:27.381233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1296f-2ea5-4ee5-89c3-ac1e75008156 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:27.381525 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1296f-2ea5-4ee5-89c3-ac1e75008156 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:27.381800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c1296f-2ea5-4ee5-89c3-ac1e75008156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:27.404822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-27c1296f-2ea5-4ee5-89c3-ac1e75008156 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:27.406023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-27c1296f-2ea5-4ee5-89c3-ac1e75008156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:27.487995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 150/296] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:27.610791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7263a-7479-4a4b-85b7-c6ba92331681 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:27.611108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7263a-7479-4a4b-85b7-c6ba92331681 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:27.611347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7263a-7479-4a4b-85b7-c6ba92331681 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:27.613022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 147/297] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:27.618306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161665c-36d3-4bee-8524-c1c2b174fd73 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:27.618850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161665c-36d3-4bee-8524-c1c2b174fd73 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:27.619340 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161665c-36d3-4bee-8524-c1c2b174fd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:27.641243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-d161665c-36d3-4bee-8524-c1c2b174fd73 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:27.642732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d161665c-36d3-4bee-8524-c1c2b174fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:27.657849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:27.728462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 151/298] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:27.797108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7263a-7479-4a4b-85b7-c6ba92331681 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:27.802063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:27.855671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1f93-4935-4ca7-a9d0-83daf3e89d4d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:27.856045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1f93-4935-4ca7-a9d0-83daf3e89d4d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:27.856479 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c1f93-4935-4ca7-a9d0-83daf3e89d4d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:27.858087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 152/299] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:27.863210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f45db-918a-434d-b46c-6da75ad05d15 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:27.863500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f45db-918a-434d-b46c-6da75ad05d15 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:27.863780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2f45db-918a-434d-b46c-6da75ad05d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:27.882830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8c2f45db-918a-434d-b46c-6da75ad05d15 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:27.884157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8c2f45db-918a-434d-b46c-6da75ad05d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:27.906831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7263a-7479-4a4b-85b7-c6ba92331681 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:27.942258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8213e76-efb1-4b6f-813f-97dc84f5d9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:27.942897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213e76-efb1-4b6f-813f-97dc84f5d9f7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:27.943430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213e76-efb1-4b6f-813f-97dc84f5d9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:27.943712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8213e76-efb1-4b6f-813f-97dc84f5d9f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:27.957807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8213e76-efb1-4b6f-813f-97dc84f5d9f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:27.958290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 153/300] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-d8213e76-efb1-4b6f-813f-97dc84f5d9f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:27.963501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:27.964590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:27.965678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:27.969362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 148/301] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:27.970759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f45db-918a-434d-b46c-6da75ad05d15 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.033276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8213e76-efb1-4b6f-813f-97dc84f5d9f7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.058411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:28.086922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2f45db-918a-434d-b46c-6da75ad05d15 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.124906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:28.133668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:28.134812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.135295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.135734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.136821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:28.137884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:28.140361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:28.150022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 154/302] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:28.156926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.166418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8213e76-efb1-4b6f-813f-97dc84f5d9f7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.201833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb707de0-c826-4ed2-be6d-70dad9a53412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:28.202472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb707de0-c826-4ed2-be6d-70dad9a53412 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.202751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb707de0-c826-4ed2-be6d-70dad9a53412 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.203024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb707de0-c826-4ed2-be6d-70dad9a53412 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.204137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb707de0-c826-4ed2-be6d-70dad9a53412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:28.205680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb707de0-c826-4ed2-be6d-70dad9a53412 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:28.207762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 149/303] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:28.213150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb707de0-c826-4ed2-be6d-70dad9a53412 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.267867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5675d-6474-4555-84de-ff24bdeb9d15 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.303699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd17aa7-6bd9-4da5-b22a-4b0a5a6b85a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:28.304614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd17aa7-6bd9-4da5-b22a-4b0a5a6b85a1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.305065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd17aa7-6bd9-4da5-b22a-4b0a5a6b85a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.305611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd17aa7-6bd9-4da5-b22a-4b0a5a6b85a1 None admin] PATH_INFO: `/v3/users/ec5a11d83c604fccb5c12e18d87b86dc` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.316614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:28.317701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb707de0-c826-4ed2-be6d-70dad9a53412 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.321634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd17aa7-6bd9-4da5-b22a-4b0a5a6b85a1 None admin] RBAC: Authorizing `identity:get_user(user_id=ec5a11d83c604fccb5c12e18d87b86dc)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:28.323279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd17aa7-6bd9-4da5-b22a-4b0a5a6b85a1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:28.325899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 155/304] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:28 2022] GET /identity/v3/users/ec5a11d83c604fccb5c12e18d87b86dc => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:28.331724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd17aa7-6bd9-4da5-b22a-4b0a5a6b85a1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.351327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:28.357377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ddd5a-9c2f-4acc-b1b7-96bc88623af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:28.358088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ddd5a-9c2f-4acc-b1b7-96bc88623af7 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.358377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ddd5a-9c2f-4acc-b1b7-96bc88623af7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.358826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ddd5a-9c2f-4acc-b1b7-96bc88623af7 None admin] PATH_INFO: `/v3/groups` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.359285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ddd5a-9c2f-4acc-b1b7-96bc88623af7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:28.360773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ddd5a-9c2f-4acc-b1b7-96bc88623af7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:28.388223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 150/305] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Aug 31 09:32:28 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:32:28.388223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ddd5a-9c2f-4acc-b1b7-96bc88623af7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.444655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd17aa7-6bd9-4da5-b22a-4b0a5a6b85a1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.484876 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe826e-f86f-4839-826c-60cbe4d927fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:28.485521 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe826e-f86f-4839-826c-60cbe4d927fe None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.485859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe826e-f86f-4839-826c-60cbe4d927fe None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.486140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe826e-f86f-4839-826c-60cbe4d927fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.498130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe826e-f86f-4839-826c-60cbe4d927fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1ebe826e-f86f-4839-826c-60cbe4d927fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:28.503357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:28.504294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:28.505093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 156/306] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:28.515986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe826e-f86f-4839-826c-60cbe4d927fe None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.544331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ddd5a-9c2f-4acc-b1b7-96bc88623af7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.586818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:28.587432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.587713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.587986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.589045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] RBAC: Adding query filter params (role.id=e88008987bf44713a9598a0e5b5ff146, user.id=ec5a11d83c604fccb5c12e18d87b86dc, scope.system=all) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:28.589045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:28.591083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:28.595240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:28.598347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 151/307] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 31 09:32:28 2022] GET /identity/v3/role_assignments?user.id=ec5a11d83c604fccb5c12e18d87b86dc&scope.system=all&role.id=e88008987bf44713a9598a0e5b5ff146 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:28.644987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe826e-f86f-4839-826c-60cbe4d927fe None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.685451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:28.686073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.686356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.686634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.687311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:28.687613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:28.689066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:28.698967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 157/308] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:28.706098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.776720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:28.826061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df189a-b60c-47d4-a039-ca47acdc44bf None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.862631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3973c98-eeee-45b0-92d2-7246d429c54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:28.863624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3973c98-eeee-45b0-92d2-7246d429c54d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.864162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3973c98-eeee-45b0-92d2-7246d429c54d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.864654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3973c98-eeee-45b0-92d2-7246d429c54d None admin] PATH_INFO: `/v3/users/12bd6ba547f64f939cfc3a34b0f2a989` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.866023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3973c98-eeee-45b0-92d2-7246d429c54d None admin] RBAC: Authorizing `identity:get_user(user_id=12bd6ba547f64f939cfc3a34b0f2a989)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:28.867670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3973c98-eeee-45b0-92d2-7246d429c54d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:28.874181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 152/309] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:28 2022] GET /identity/v3/users/12bd6ba547f64f939cfc3a34b0f2a989 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:28.876335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:28.969784 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954421-2a60-403a-8c08-079d9100e346 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.970062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954421-2a60-403a-8c08-079d9100e346 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.970257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954421-2a60-403a-8c08-079d9100e346 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.971591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 153/310] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:28.976359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a2d0d-bda0-4b1c-9d90-12f1ab800896 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:28.976670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a2d0d-bda0-4b1c-9d90-12f1ab800896 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:28.976914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a2d0d-bda0-4b1c-9d90-12f1ab800896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:28.988538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9775971-8b06-4f61-883c-f8f2108d6ba1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:28.997792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f93a2d0d-bda0-4b1c-9d90-12f1ab800896 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:28.999014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f93a2d0d-bda0-4b1c-9d90-12f1ab800896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:29.011563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:29.032392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dc7a6-0592-446f-9a93-c73b8830c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:29.033362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dc7a6-0592-446f-9a93-c73b8830c809 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:29.033651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dc7a6-0592-446f-9a93-c73b8830c809 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:29.033930 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4dc7a6-0592-446f-9a93-c73b8830c809 None admin] PATH_INFO: `/v3/system/users/12bd6ba547f64f939cfc3a34b0f2a989/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:29.036451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dc7a6-0592-446f-9a93-c73b8830c809 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=12bd6ba547f64f939cfc3a34b0f2a989, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:29.038523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4dc7a6-0592-446f-9a93-c73b8830c809 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:29.053203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 158/311] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Aug 31 09:32:28 2022] PUT /identity/v3/system/users/12bd6ba547f64f939cfc3a34b0f2a989/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:29.089137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 154/312] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:29.357262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dc7a6-0592-446f-9a93-c73b8830c809 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:29.487622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4dc7a6-0592-446f-9a93-c73b8830c809 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:29.523993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd69dcf-4218-4aec-88ff-4cda64eed57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:29.524660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd69dcf-4218-4aec-88ff-4cda64eed57a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:29.524943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd69dcf-4218-4aec-88ff-4cda64eed57a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:29.525216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd69dcf-4218-4aec-88ff-4cda64eed57a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:29.536008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd69dcf-4218-4aec-88ff-4cda64eed57a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-cfd69dcf-4218-4aec-88ff-4cda64eed57a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:29.541553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:29.542603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:29.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 159/313] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:29.548841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a2d0d-bda0-4b1c-9d90-12f1ab800896 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:29.610019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:29.665154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a2d0d-bda0-4b1c-9d90-12f1ab800896 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:29.706279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:29.706893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:29.707167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:29.707433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:29.708153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:29.708480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:29.709905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:29.720640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 155/314] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:29.729660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd69dcf-4218-4aec-88ff-4cda64eed57a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:29.777770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:29.834581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd69dcf-4218-4aec-88ff-4cda64eed57a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:29.869586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a143b-4ecb-432e-a3ab-1270b606bb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:29.870142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a143b-4ecb-432e-a3ab-1270b606bb85 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:29.870465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a143b-4ecb-432e-a3ab-1270b606bb85 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:29.870771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a143b-4ecb-432e-a3ab-1270b606bb85 None admin] PATH_INFO: `/v3/users/0985a2e21d954d5cb22e9f1ae9349081` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:29.871970 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a143b-4ecb-432e-a3ab-1270b606bb85 None admin] RBAC: Authorizing `identity:get_user(user_id=0985a2e21d954d5cb22e9f1ae9349081)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:29.873474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a143b-4ecb-432e-a3ab-1270b606bb85 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:29.875228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 160/315] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:29 2022] GET /identity/v3/users/0985a2e21d954d5cb22e9f1ae9349081 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:29.880886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:29.989108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17430d-76b0-4152-a7e6-ee039892d330 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:30.006107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:30.026182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff41640-4af0-484f-a8f6-629a4988b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:30.027424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff41640-4af0-484f-a8f6-629a4988b44a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:30.027704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff41640-4af0-484f-a8f6-629a4988b44a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:30.027972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff41640-4af0-484f-a8f6-629a4988b44a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:30.099289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff41640-4af0-484f-a8f6-629a4988b44a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:30.101134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff41640-4af0-484f-a8f6-629a4988b44a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:30.208129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 156/316] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:30.213615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a143b-4ecb-432e-a3ab-1270b606bb85 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:30.317622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a143b-4ecb-432e-a3ab-1270b606bb85 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:30.331178 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:30.353374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444496a-6f1c-4bc9-b5ce-103b992941e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:30.354272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444496a-6f1c-4bc9-b5ce-103b992941e8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:30.355189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444496a-6f1c-4bc9-b5ce-103b992941e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:30.355552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444496a-6f1c-4bc9-b5ce-103b992941e8 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:30.356733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444496a-6f1c-4bc9-b5ce-103b992941e8 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:30.358193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444496a-6f1c-4bc9-b5ce-103b992941e8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:30.364272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 161/317] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:30 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:30.366063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff41640-4af0-484f-a8f6-629a4988b44a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:30.384366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:30.472232 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff41640-4af0-484f-a8f6-629a4988b44a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:30.507233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45399421-bbcb-430b-a7c5-416114bc11a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:30.507846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399421-bbcb-430b-a7c5-416114bc11a1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:30.508123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399421-bbcb-430b-a7c5-416114bc11a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:30.508417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45399421-bbcb-430b-a7c5-416114bc11a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:30.509141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399421-bbcb-430b-a7c5-416114bc11a1 None admin] RBAC: Adding query filter params (role.id=e88008987bf44713a9598a0e5b5ff146, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9, user.id=0985a2e21d954d5cb22e9f1ae9349081) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:30.509440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399421-bbcb-430b-a7c5-416114bc11a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:30.511606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45399421-bbcb-430b-a7c5-416114bc11a1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:30.518117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 157/318] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:30 2022] GET /identity/v3/role_assignments?user.id=0985a2e21d954d5cb22e9f1ae9349081&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=e88008987bf44713a9598a0e5b5ff146 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:30.524218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ac89-0f74-4525-b00a-97371ffed04f None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:30.524785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ac89-0f74-4525-b00a-97371ffed04f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:30.525359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174ac89-0f74-4525-b00a-97371ffed04f None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:30.528027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 162/319] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:30.534267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0085a0-9a36-4715-9693-ed51f78e7ec4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:30.534878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0085a0-9a36-4715-9693-ed51f78e7ec4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:30.535350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0085a0-9a36-4715-9693-ed51f78e7ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:30.556487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7b0085a0-9a36-4715-9693-ed51f78e7ec4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:30.559394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7b0085a0-9a36-4715-9693-ed51f78e7ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:30.611552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824f5d-8044-4b21-a6b3-17ebeee69c22 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:30.612222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824f5d-8044-4b21-a6b3-17ebeee69c22 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:30.612697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a824f5d-8044-4b21-a6b3-17ebeee69c22 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:30.615336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 163/320] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:30.626256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdfc22-7ea2-4842-bcf5-b7fdf223faf1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:30.627360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdfc22-7ea2-4842-bcf5-b7fdf223faf1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:30.627843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdfc22-7ea2-4842-bcf5-b7fdf223faf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:30.646893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 158/321] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:30.655466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9fcdfc22-7ea2-4842-bcf5-b7fdf223faf1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:30.656760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9fcdfc22-7ea2-4842-bcf5-b7fdf223faf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:30.742398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 164/322] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:30.926540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0085a0-9a36-4715-9693-ed51f78e7ec4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:30.939386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:31.011661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdfc22-7ea2-4842-bcf5-b7fdf223faf1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:31.030531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0085a0-9a36-4715-9693-ed51f78e7ec4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:31.064767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0967a122-2bd4-404e-a987-95f716d239c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:31.065394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a122-2bd4-404e-a987-95f716d239c9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.065665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a122-2bd4-404e-a987-95f716d239c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.065930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0967a122-2bd4-404e-a987-95f716d239c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.077461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0967a122-2bd4-404e-a987-95f716d239c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0967a122-2bd4-404e-a987-95f716d239c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:31.083070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:31.084042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 159/323] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:31.086645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d7cc-654f-4c50-acfd-023338bd6bef None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.088081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d7cc-654f-4c50-acfd-023338bd6bef None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.088081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154d7cc-654f-4c50-acfd-023338bd6bef None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.088081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 160/324] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:31.092571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154d7cc-654f-4c50-acfd-023338bd6bef None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:31.113479 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdfc22-7ea2-4842-bcf5-b7fdf223faf1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:31.124756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:31.151792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e302a-5029-497f-a686-fc21a2af1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:31.152471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e302a-5029-497f-a686-fc21a2af1885 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.152757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e302a-5029-497f-a686-fc21a2af1885 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.153036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e302a-5029-497f-a686-fc21a2af1885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.154151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e302a-5029-497f-a686-fc21a2af1885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:31.155619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e302a-5029-497f-a686-fc21a2af1885 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:31.157219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 165/325] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:31.160454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf42d7-b18b-4065-86dd-0178795b931d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.160454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf42d7-b18b-4065-86dd-0178795b931d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.160454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf42d7-b18b-4065-86dd-0178795b931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.164387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:31.177547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3daf42d7-b18b-4065-86dd-0178795b931d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:31.178738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3daf42d7-b18b-4065-86dd-0178795b931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:31.197194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154d7cc-654f-4c50-acfd-023338bd6bef None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:31.231526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:31.232129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.232438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.232711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.233377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:31.233676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:31.235065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:31.243485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 161/326] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:31.244943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:31.248350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 166/327] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:31.249552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf42d7-b18b-4065-86dd-0178795b931d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:31.355269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85341c32-e5dd-4ada-a254-fe0e4ec8c479 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:31.361032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf42d7-b18b-4065-86dd-0178795b931d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:31.370822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:31.389669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:31.395239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4262c-8518-4008-9cff-5486dac8c16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:31.396048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4262c-8518-4008-9cff-5486dac8c16b None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.396365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4262c-8518-4008-9cff-5486dac8c16b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.396638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4262c-8518-4008-9cff-5486dac8c16b None admin] PATH_INFO: `/v3/groups` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.397274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4262c-8518-4008-9cff-5486dac8c16b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:31.398705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4262c-8518-4008-9cff-5486dac8c16b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:31.399181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52e1d-f5b5-4c13-b57d-714b2427e44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:31.399809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52e1d-f5b5-4c13-b57d-714b2427e44a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.400088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52e1d-f5b5-4c13-b57d-714b2427e44a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.400400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca52e1d-f5b5-4c13-b57d-714b2427e44a None admin] PATH_INFO: `/v3/users/ec5a11d83c604fccb5c12e18d87b86dc` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.402129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca52e1d-f5b5-4c13-b57d-714b2427e44a None admin] RBAC: Authorizing `identity:get_user(user_id=ec5a11d83c604fccb5c12e18d87b86dc)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:31.403824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca52e1d-f5b5-4c13-b57d-714b2427e44a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:31.405951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 167/328] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:31 2022] GET /identity/v3/users/ec5a11d83c604fccb5c12e18d87b86dc => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:31.412263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52e1d-f5b5-4c13-b57d-714b2427e44a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:31.420469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 162/329] 10.222.0.18 () {60 vars in 1134 bytes} [Wed Aug 31 09:32:31 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:31.524774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4262c-8518-4008-9cff-5486dac8c16b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:31.544610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca52e1d-f5b5-4c13-b57d-714b2427e44a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:31.587594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691c3cf-2b73-42c3-9abc-87f8c4730bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:31.587594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691c3cf-2b73-42c3-9abc-87f8c4730bea None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.587594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691c3cf-2b73-42c3-9abc-87f8c4730bea None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.587594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691c3cf-2b73-42c3-9abc-87f8c4730bea None admin] PATH_INFO: `/v3/system/users/ec5a11d83c604fccb5c12e18d87b86dc/roles/e88008987bf44713a9598a0e5b5ff146` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.589078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691c3cf-2b73-42c3-9abc-87f8c4730bea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ec5a11d83c604fccb5c12e18d87b86dc, role_id=e88008987bf44713a9598a0e5b5ff146)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:31.590469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691c3cf-2b73-42c3-9abc-87f8c4730bea None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:31.601436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 168/330] 10.222.0.18 () {58 vars in 1334 bytes} [Wed Aug 31 09:32:31 2022] PUT /identity/v3/system/users/ec5a11d83c604fccb5c12e18d87b86dc/roles/e88008987bf44713a9598a0e5b5ff146 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:32:31.645359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4262c-8518-4008-9cff-5486dac8c16b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:31.691452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c111f03-fdb1-4719-b3fb-675d2aab5beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:31.692541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111f03-fdb1-4719-b3fb-675d2aab5beb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.693131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111f03-fdb1-4719-b3fb-675d2aab5beb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.693537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c111f03-fdb1-4719-b3fb-675d2aab5beb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.706989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c111f03-fdb1-4719-b3fb-675d2aab5beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0c111f03-fdb1-4719-b3fb-675d2aab5beb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:31.713402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:31.714810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:31.715772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:31.718296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 163/331] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:31.724414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691c3cf-2b73-42c3-9abc-87f8c4730bea None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:31.776751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:31.842007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691c3cf-2b73-42c3-9abc-87f8c4730bea None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:31.878826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:31.879439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:31.879721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:31.879996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:31.880701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:31.881009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:31.882401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:31.892467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 169/332] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:31.898269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c111f03-fdb1-4719-b3fb-675d2aab5beb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:31.959851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:32.022217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c111f03-fdb1-4719-b3fb-675d2aab5beb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:32.063070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec785315-07a3-41fd-9f8e-dbaa5990b2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:32.063706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785315-07a3-41fd-9f8e-dbaa5990b2a4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:32.063984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785315-07a3-41fd-9f8e-dbaa5990b2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:32.064286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec785315-07a3-41fd-9f8e-dbaa5990b2a4 None admin] PATH_INFO: `/v3/users/12bd6ba547f64f939cfc3a34b0f2a989` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:32.065456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec785315-07a3-41fd-9f8e-dbaa5990b2a4 None admin] RBAC: Authorizing `identity:get_user(user_id=12bd6ba547f64f939cfc3a34b0f2a989)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:32.066904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec785315-07a3-41fd-9f8e-dbaa5990b2a4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:32.068824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 164/333] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:31 2022] GET /identity/v3/users/12bd6ba547f64f939cfc3a34b0f2a989 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:32.077599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:32.204390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99306cd8-47f6-43b6-a556-aab7fec8b668 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:32.205925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:32.253948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f3e62-fcc2-4315-96d2-4b19727ff826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:32.254559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f3e62-fcc2-4315-96d2-4b19727ff826 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:32.254842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f3e62-fcc2-4315-96d2-4b19727ff826 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:32.255118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f3e62-fcc2-4315-96d2-4b19727ff826 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:32.255849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f3e62-fcc2-4315-96d2-4b19727ff826 None admin] RBAC: Adding query filter params (role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, user.id=12bd6ba547f64f939cfc3a34b0f2a989, scope.system=all) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:32.256157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f3e62-fcc2-4315-96d2-4b19727ff826 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:32.257639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f3e62-fcc2-4315-96d2-4b19727ff826 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:32.273328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 170/334] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 31 09:32:32 2022] GET /identity/v3/role_assignments?user.id=12bd6ba547f64f939cfc3a34b0f2a989&scope.system=all&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:33.761543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e9c67-9e3f-4e46-a21c-ee8df748b7ab None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:33.762496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e9c67-9e3f-4e46-a21c-ee8df748b7ab None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:33.762966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e9c67-9e3f-4e46-a21c-ee8df748b7ab None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:33.764554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 165/335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:33.770395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5d35-d615-4f1c-91d5-ee18a650f74c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:33.771277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5d35-d615-4f1c-91d5-ee18a650f74c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:33.771743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a5d35-d615-4f1c-91d5-ee18a650f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:33.797319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-878a5d35-d615-4f1c-91d5-ee18a650f74c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:33.798523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-878a5d35-d615-4f1c-91d5-ee18a650f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:33.858033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd89c7-7343-43a7-a93e-27aaafcd8d09 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:33.858629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd89c7-7343-43a7-a93e-27aaafcd8d09 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:33.859109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd89c7-7343-43a7-a93e-27aaafcd8d09 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:33.860924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 166/336] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:33.879917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b85fe-ea6d-4695-9d59-e6ba2143c809 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:33.880543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b85fe-ea6d-4695-9d59-e6ba2143c809 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:33.881036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b85fe-ea6d-4695-9d59-e6ba2143c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:33.882579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 171/337] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:33.916340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8d6b85fe-ea6d-4695-9d59-e6ba2143c809 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:33.917952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8d6b85fe-ea6d-4695-9d59-e6ba2143c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:33.935959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b48794-939f-4697-83f7-84953328d273 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:33.936651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b48794-939f-4697-83f7-84953328d273 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:33.937129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b48794-939f-4697-83f7-84953328d273 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:33.938675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 172/338] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:33.947195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ba9a-145d-49af-a7ef-208a24b07a32 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:33.947814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ba9a-145d-49af-a7ef-208a24b07a32 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:33.948431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43ba9a-145d-49af-a7ef-208a24b07a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:33.974749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9c43ba9a-145d-49af-a7ef-208a24b07a32 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:33.978459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9c43ba9a-145d-49af-a7ef-208a24b07a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:34.048287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 167/339] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:34.088782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 173/340] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:34.389321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b85fe-ea6d-4695-9d59-e6ba2143c809 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:34.405388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ba9a-145d-49af-a7ef-208a24b07a32 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:34.432683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:34.449715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:34.514272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b85fe-ea6d-4695-9d59-e6ba2143c809 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:34.559082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd6ec4-e915-43f0-bee3-4df7d9deeb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:34.559725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd6ec4-e915-43f0-bee3-4df7d9deeb7e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:34.560003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd6ec4-e915-43f0-bee3-4df7d9deeb7e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:34.560307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd6ec4-e915-43f0-bee3-4df7d9deeb7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:34.574309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd6ec4-e915-43f0-bee3-4df7d9deeb7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-23fd6ec4-e915-43f0-bee3-4df7d9deeb7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:34.580038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:34.580978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 09:32:34.581752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:34.583295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 168/341] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:34.583576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd6ec4-e915-43f0-bee3-4df7d9deeb7e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:34.599874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43ba9a-145d-49af-a7ef-208a24b07a32 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:34.667116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba482-3883-43e9-8274-6ce525999802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:34.667670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba482-3883-43e9-8274-6ce525999802 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:34.667946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba482-3883-43e9-8274-6ce525999802 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:34.668234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bba482-3883-43e9-8274-6ce525999802 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:34.688077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bba482-3883-43e9-8274-6ce525999802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-26bba482-3883-43e9-8274-6ce525999802 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:34.697277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:34.698233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:34.699013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:34.703367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 174/342] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:34.704451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba482-3883-43e9-8274-6ce525999802 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:34.719975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd6ec4-e915-43f0-bee3-4df7d9deeb7e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:34.737633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:34.771467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202dd77-9dc7-46c1-ae96-e6895e0b1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:34.772063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202dd77-9dc7-46c1-ae96-e6895e0b1b18 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:34.772063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202dd77-9dc7-46c1-ae96-e6895e0b1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:34.772236 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202dd77-9dc7-46c1-ae96-e6895e0b1b18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:34.791947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202dd77-9dc7-46c1-ae96-e6895e0b1b18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1202dd77-9dc7-46c1-ae96-e6895e0b1b18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:34.796980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:34.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:34.798670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 169/343] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:34.799330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741f6c-c8eb-430d-bfe1-4a511eee2b5d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:34.800146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741f6c-c8eb-430d-bfe1-4a511eee2b5d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:34.800146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db741f6c-c8eb-430d-bfe1-4a511eee2b5d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:34.802041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 170/344] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:34.802802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db741f6c-c8eb-430d-bfe1-4a511eee2b5d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:34.822236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:34.851303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bba482-3883-43e9-8274-6ce525999802 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:34.895909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:34.896782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:34.897020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:34.897302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:34.898819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:34.898994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:34.900544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:34.909809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 175/345] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:34.913029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:34.948712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db741f6c-c8eb-430d-bfe1-4a511eee2b5d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:34.988545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0924993b-a0ee-4b2b-bc89-694810227f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:34.989979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924993b-a0ee-4b2b-bc89-694810227f8c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:34.990448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924993b-a0ee-4b2b-bc89-694810227f8c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:34.990920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924993b-a0ee-4b2b-bc89-694810227f8c None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:34.991764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924993b-a0ee-4b2b-bc89-694810227f8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:34.993074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924993b-a0ee-4b2b-bc89-694810227f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:34.994710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0924993b-a0ee-4b2b-bc89-694810227f8c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:35.003798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 171/346] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:35.005434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee505-e0df-48a4-bc2f-023cff5705f4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:35.005960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee505-e0df-48a4-bc2f-023cff5705f4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:35.006434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ee505-e0df-48a4-bc2f-023cff5705f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:35.029777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-882ee505-e0df-48a4-bc2f-023cff5705f4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:35.031452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-882ee505-e0df-48a4-bc2f-023cff5705f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:35.040202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7084f28-b241-4628-bdd7-79aa658e43ae None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:35.065880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:35.080381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:35.081045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:35.081321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:35.081591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:35.082307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:35.082610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:35.083997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:35.093350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 176/347] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:35.094225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:35.098328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:35.124752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 172/348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:35.126414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee505-e0df-48a4-bc2f-023cff5705f4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:35.246839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ee505-e0df-48a4-bc2f-023cff5705f4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:35.274684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814b354-7269-4d9e-8b35-e9f4c930c9e8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:35.288697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386098-3385-4de9-b942-4a3d2b6359bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:35.290963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386098-3385-4de9-b942-4a3d2b6359bb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:35.291455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386098-3385-4de9-b942-4a3d2b6359bb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:35.291939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8386098-3385-4de9-b942-4a3d2b6359bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:35.332720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:35.342938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67d21-a7ce-49d5-b26f-e67a63d2d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:35.343912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67d21-a7ce-49d5-b26f-e67a63d2d0ea None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:35.344023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67d21-a7ce-49d5-b26f-e67a63d2d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:35.344254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67d21-a7ce-49d5-b26f-e67a63d2d0ea None admin] PATH_INFO: `/v3/users/ec5a11d83c604fccb5c12e18d87b86dc` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:35.345915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67d21-a7ce-49d5-b26f-e67a63d2d0ea None admin] RBAC: Authorizing `identity:get_user(user_id=ec5a11d83c604fccb5c12e18d87b86dc)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:35.348284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67d21-a7ce-49d5-b26f-e67a63d2d0ea None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:35.357208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 177/349] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:32:35 2022] GET /identity/v3/users/ec5a11d83c604fccb5c12e18d87b86dc => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:35.358043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67d21-a7ce-49d5-b26f-e67a63d2d0ea None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:35.378581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8386098-3385-4de9-b942-4a3d2b6359bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:35.380752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8386098-3385-4de9-b942-4a3d2b6359bb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:35.475785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:35.513162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67d21-a7ce-49d5-b26f-e67a63d2d0ea None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:35.517555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 173/350] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:35.518525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386098-3385-4de9-b942-4a3d2b6359bb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:35.557681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc4ede-ebbe-4ee7-b7d4-934a80046ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:35.558342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4ede-ebbe-4ee7-b7d4-934a80046ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:35.558670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4ede-ebbe-4ee7-b7d4-934a80046ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:35.558940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc4ede-ebbe-4ee7-b7d4-934a80046ab2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:35.610917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:35.646289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc4ede-ebbe-4ee7-b7d4-934a80046ab2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:35.648842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc4ede-ebbe-4ee7-b7d4-934a80046ab2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:35.660894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8386098-3385-4de9-b942-4a3d2b6359bb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:35.709068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:35.709683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:35.710111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:35.710421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:35.712744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] RBAC: Adding query filter params (role.id=e88008987bf44713a9598a0e5b5ff146, user.id=ec5a11d83c604fccb5c12e18d87b86dc, scope.system=all) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:35.713195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:35.715113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:35.743139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 174/351] 10.222.0.18 () {56 vars in 1308 bytes} [Wed Aug 31 09:32:35 2022] GET /identity/v3/role_assignments?user.id=ec5a11d83c604fccb5c12e18d87b86dc&scope.system=all&role.id=e88008987bf44713a9598a0e5b5ff146 => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:35.744095 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:35.773258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:35.825014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 178/352] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:35.825959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc4ede-ebbe-4ee7-b7d4-934a80046ab2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:35.946222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb395e89-6aff-43ec-bdb5-f39e23c0a446 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:35.970108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:35.986793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679c870-e9e2-4f30-89bb-65353d22aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:35.987439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679c870-e9e2-4f30-89bb-65353d22aa31 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:35.987722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679c870-e9e2-4f30-89bb-65353d22aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:35.987994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679c870-e9e2-4f30-89bb-65353d22aa31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.000664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9679c870-e9e2-4f30-89bb-65353d22aa31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9679c870-e9e2-4f30-89bb-65353d22aa31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:36.006251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:36.007723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:36.008612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 175/353] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:36.009247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679c870-e9e2-4f30-89bb-65353d22aa31 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:36.020981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc4ede-ebbe-4ee7-b7d4-934a80046ab2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.063390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061108e9-e9b1-4f18-8428-4955b1d03344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.063980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061108e9-e9b1-4f18-8428-4955b1d03344 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.064380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061108e9-e9b1-4f18-8428-4955b1d03344 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.064663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061108e9-e9b1-4f18-8428-4955b1d03344 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.065912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061108e9-e9b1-4f18-8428-4955b1d03344 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:36.067379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061108e9-e9b1-4f18-8428-4955b1d03344 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:36.069449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 179/354] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:35 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:36.071252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061108e9-e9b1-4f18-8428-4955b1d03344 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:36.124304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:36.135711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679c870-e9e2-4f30-89bb-65353d22aa31 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.171976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80ad3e-7c30-40d0-893c-276572501e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.172671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80ad3e-7c30-40d0-893c-276572501e7e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.172950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80ad3e-7c30-40d0-893c-276572501e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.173224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80ad3e-7c30-40d0-893c-276572501e7e None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.174365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80ad3e-7c30-40d0-893c-276572501e7e None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:36.175812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb80ad3e-7c30-40d0-893c-276572501e7e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:36.177476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 176/355] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:36 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:36.178597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855abd-a98a-44f3-87f7-24c5150c11b6 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.178944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855abd-a98a-44f3-87f7-24c5150c11b6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.179729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8855abd-a98a-44f3-87f7-24c5150c11b6 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.181243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 177/356] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:36.181759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8855abd-a98a-44f3-87f7-24c5150c11b6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:36.194027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061108e9-e9b1-4f18-8428-4955b1d03344 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.232869 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b203ef-482f-4661-8e2e-08dc131c434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.233527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b203ef-482f-4661-8e2e-08dc131c434d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.233813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b203ef-482f-4661-8e2e-08dc131c434d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.234086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b203ef-482f-4661-8e2e-08dc131c434d None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.235291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b203ef-482f-4661-8e2e-08dc131c434d None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:36.235603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b203ef-482f-4661-8e2e-08dc131c434d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:36.237045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b203ef-482f-4661-8e2e-08dc131c434d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:36.242802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:36.249144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 180/357] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:36.250602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4a41-ed5c-46a3-b724-7a58da5a5a34 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.250982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4a41-ed5c-46a3-b724-7a58da5a5a34 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.251390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ea4a41-ed5c-46a3-b724-7a58da5a5a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.276774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-22ea4a41-ed5c-46a3-b724-7a58da5a5a34 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:36.278067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-22ea4a41-ed5c-46a3-b724-7a58da5a5a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:36.310052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8855abd-a98a-44f3-87f7-24c5150c11b6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.351464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a190f-737c-425e-8cfa-e72f7f7ca321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.352105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a190f-737c-425e-8cfa-e72f7f7ca321 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.353268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a190f-737c-425e-8cfa-e72f7f7ca321 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.353546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a190f-737c-425e-8cfa-e72f7f7ca321 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.360814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 181/358] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:36.361080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a190f-737c-425e-8cfa-e72f7f7ca321 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:36.362557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a190f-737c-425e-8cfa-e72f7f7ca321 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:36.364441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 178/359] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:36 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:36.364986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a190f-737c-425e-8cfa-e72f7f7ca321 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:36.368075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea4a41-ed5c-46a3-b724-7a58da5a5a34 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:36.408956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:36.501973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ea4a41-ed5c-46a3-b724-7a58da5a5a34 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.510932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a190f-737c-425e-8cfa-e72f7f7ca321 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.530050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:36.551269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4f17-3588-4fd4-b3bb-dda8b41a5850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.551943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4f17-3588-4fd4-b3bb-dda8b41a5850 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.552290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4f17-3588-4fd4-b3bb-dda8b41a5850 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.552574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe4f17-3588-4fd4-b3bb-dda8b41a5850 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.554274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe4f17-3588-4fd4-b3bb-dda8b41a5850 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:36.555867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe4f17-3588-4fd4-b3bb-dda8b41a5850 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:36.557664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 182/360] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:36 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:36.558271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4f17-3588-4fd4-b3bb-dda8b41a5850 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:36.565459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ccca-87dd-4f74-b949-e80daadc5de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.566353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ccca-87dd-4f74-b949-e80daadc5de5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.566638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ccca-87dd-4f74-b949-e80daadc5de5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.566909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8ccca-87dd-4f74-b949-e80daadc5de5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.655348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8ccca-87dd-4f74-b949-e80daadc5de5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:36.656951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8ccca-87dd-4f74-b949-e80daadc5de5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:36.696142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:36.699914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe4f17-3588-4fd4-b3bb-dda8b41a5850 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.742903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff797b-baff-4efe-accb-b239c058931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.743525 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff797b-baff-4efe-accb-b239c058931a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.743959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff797b-baff-4efe-accb-b239c058931a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.744273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff797b-baff-4efe-accb-b239c058931a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.748211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff797b-baff-4efe-accb-b239c058931a None admin] RBAC: Adding query filter params (group.id=31462a4b9a79416ba7ab3efcd9dde2d1, role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=03aab93361d540d59cc78163f7da6239) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:36.748211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff797b-baff-4efe-accb-b239c058931a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:36.748211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fff797b-baff-4efe-accb-b239c058931a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:36.753937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 183/361] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:36 2022] GET /identity/v3/role_assignments?group.id=31462a4b9a79416ba7ab3efcd9dde2d1&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:36.754564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c015c7d-f96e-491e-acc3-48badc793225 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.755135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c015c7d-f96e-491e-acc3-48badc793225 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.755135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c015c7d-f96e-491e-acc3-48badc793225 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.756554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 184/362] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:36.757818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c015c7d-f96e-491e-acc3-48badc793225 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:36.789745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 179/363] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:36.790914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ccca-87dd-4f74-b949-e80daadc5de5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:36.814494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:36.907546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c015c7d-f96e-491e-acc3-48badc793225 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.941190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8ccca-87dd-4f74-b949-e80daadc5de5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:36.949406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c107b-bb31-47f9-8991-d3c19d0bcc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.953166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c107b-bb31-47f9-8991-d3c19d0bcc08 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.953166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c107b-bb31-47f9-8991-d3c19d0bcc08 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.953166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c107b-bb31-47f9-8991-d3c19d0bcc08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.953166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c107b-bb31-47f9-8991-d3c19d0bcc08 None admin] RBAC: Adding query filter params (group.id=31462a4b9a79416ba7ab3efcd9dde2d1, role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=03aab93361d540d59cc78163f7da6239) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:36.953166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c107b-bb31-47f9-8991-d3c19d0bcc08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:36.953537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c107b-bb31-47f9-8991-d3c19d0bcc08 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:36.962044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 185/364] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:36 2022] GET /identity/v3/role_assignments?group.id=31462a4b9a79416ba7ab3efcd9dde2d1&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:36.963512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d239e-554f-480b-81cb-640f6546d202 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.963861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d239e-554f-480b-81cb-640f6546d202 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.964626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d239e-554f-480b-81cb-640f6546d202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:36.985907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3f4d239e-554f-480b-81cb-640f6546d202 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:36.987727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3f4d239e-554f-480b-81cb-640f6546d202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:36.996916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3da83-ca01-4b29-82f5-fa2cfc2b4ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:36.997639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3da83-ca01-4b29-82f5-fa2cfc2b4ef5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:36.997864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3da83-ca01-4b29-82f5-fa2cfc2b4ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:36.998109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3da83-ca01-4b29-82f5-fa2cfc2b4ef5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:37.012344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3da83-ca01-4b29-82f5-fa2cfc2b4ef5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-60b3da83-ca01-4b29-82f5-fa2cfc2b4ef5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:37.017962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:37.018908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:37.019718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:37.022999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 180/365] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:37.024304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3da83-ca01-4b29-82f5-fa2cfc2b4ef5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:37.025789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:37.081676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 186/366] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:37.082867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d239e-554f-480b-81cb-640f6546d202 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:37.109892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:37.146700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3da83-ca01-4b29-82f5-fa2cfc2b4ef5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:37.191698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1aa46-4c3f-49b1-83c0-d40f796d72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:37.192415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1aa46-4c3f-49b1-83c0-d40f796d72ac None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:37.192761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1aa46-4c3f-49b1-83c0-d40f796d72ac None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:37.193038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1aa46-4c3f-49b1-83c0-d40f796d72ac None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:37.195509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1aa46-4c3f-49b1-83c0-d40f796d72ac None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:37.197064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1aa46-4c3f-49b1-83c0-d40f796d72ac None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:37.200971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 181/367] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:37 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:37.206713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1aa46-4c3f-49b1-83c0-d40f796d72ac None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:37.238809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d239e-554f-480b-81cb-640f6546d202 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:37.275115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:37.275731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:37.276068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:37.276383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:37.277120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:37.277426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:37.278880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:37.287615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 187/368] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:37.293180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:37.316657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:37.360945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1aa46-4c3f-49b1-83c0-d40f796d72ac None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:37.398930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b650f2-72a7-403e-8115-32d952d10b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:37.399568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b650f2-72a7-403e-8115-32d952d10b75 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:37.399839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b650f2-72a7-403e-8115-32d952d10b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:37.400109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b650f2-72a7-403e-8115-32d952d10b75 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:37.401270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b650f2-72a7-403e-8115-32d952d10b75 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:37.403691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b650f2-72a7-403e-8115-32d952d10b75 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:37.404956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f103c-9f7a-45b8-ae5d-32d33820bd92 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:37.405690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 182/369] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:37 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:37.414517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b650f2-72a7-403e-8115-32d952d10b75 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:37.434585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:37.464816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7ebe-8f78-4c82-bbcc-6542d1c4cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:37.465401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7ebe-8f78-4c82-bbcc-6542d1c4cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:37.465683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7ebe-8f78-4c82-bbcc-6542d1c4cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:37.465955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7ebe-8f78-4c82-bbcc-6542d1c4cdd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:37.593206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b650f2-72a7-403e-8115-32d952d10b75 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:37.597098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae7ebe-8f78-4c82-bbcc-6542d1c4cdd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:37.598600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae7ebe-8f78-4c82-bbcc-6542d1c4cdd6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:37.636565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:37.644457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:37.645353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:37.645843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:37.646305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:37.648006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] RBAC: Adding query filter params (group.id=31462a4b9a79416ba7ab3efcd9dde2d1, role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:37.648557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:37.650181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:37.656577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 183/370] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:37 2022] GET /identity/v3/role_assignments?group.id=31462a4b9a79416ba7ab3efcd9dde2d1&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:37.657618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:37.768524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 188/371] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 09:32:37.770456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:37.777520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7ebe-8f78-4c82-bbcc-6542d1c4cdd6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:37.820648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020a50c-0b56-4e73-ad40-c502b8296996 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:37.894130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a582-3aaa-42f4-9520-99ceb6aea5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:37.895121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a582-3aaa-42f4-9520-99ceb6aea5bb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:37.895592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a582-3aaa-42f4-9520-99ceb6aea5bb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:37.896072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59a582-3aaa-42f4-9520-99ceb6aea5bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:37.912721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59a582-3aaa-42f4-9520-99ceb6aea5bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ba59a582-3aaa-42f4-9520-99ceb6aea5bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:37.918733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:37.919583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:37.924929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:37.927053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 184/372] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:37.933489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a582-3aaa-42f4-9520-99ceb6aea5bb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:37.940334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7ebe-8f78-4c82-bbcc-6542d1c4cdd6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:37.964833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:37.992486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c267f-e1a8-430f-95aa-7084a9013694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:37.993061 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c267f-e1a8-430f-95aa-7084a9013694 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:37.993345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c267f-e1a8-430f-95aa-7084a9013694 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:37.993616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c267f-e1a8-430f-95aa-7084a9013694 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:37.995218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c267f-e1a8-430f-95aa-7084a9013694 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:37.997138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c267f-e1a8-430f-95aa-7084a9013694 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:37.999461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 189/373] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:37 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:38.008456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c267f-e1a8-430f-95aa-7084a9013694 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:38.096271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59a582-3aaa-42f4-9520-99ceb6aea5bb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:38.133441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:38.140562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c267f-e1a8-430f-95aa-7084a9013694 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:38.141737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:38.142678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:38.143940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:38.144418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:38.145235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:38.145683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:38.148049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:38.159981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 185/374] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:38.165412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:38.185323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec1346-b81c-461a-8cf2-fd1f15409411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:38.186191 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1346-b81c-461a-8cf2-fd1f15409411 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:38.186971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1346-b81c-461a-8cf2-fd1f15409411 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:38.187262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec1346-b81c-461a-8cf2-fd1f15409411 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:38.191901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec1346-b81c-461a-8cf2-fd1f15409411 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:38.191901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec1346-b81c-461a-8cf2-fd1f15409411 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:38.191901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 190/375] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:38 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:38.201038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec1346-b81c-461a-8cf2-fd1f15409411 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:38.295775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:38.388811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d230f5-80d4-4cbc-8b55-b701f301785b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:38.406406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec1346-b81c-461a-8cf2-fd1f15409411 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:38.467491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e4ed5-a925-435b-abf3-8138d473df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:38.468362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e4ed5-a925-435b-abf3-8138d473df62 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:38.468651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e4ed5-a925-435b-abf3-8138d473df62 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:38.468930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e4ed5-a925-435b-abf3-8138d473df62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:38.482977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:38.483605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:38.483889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:38.484194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:38.485080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] RBAC: Adding query filter params (group.id=31462a4b9a79416ba7ab3efcd9dde2d1, role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:38.485583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:38.487534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:38.499232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 191/376] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:38 2022] GET /identity/v3/role_assignments?group.id=31462a4b9a79416ba7ab3efcd9dde2d1&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:38.562527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:38.572742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e4ed5-a925-435b-abf3-8138d473df62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:38.574395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e4ed5-a925-435b-abf3-8138d473df62 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:38.705364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 186/377] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:38.712386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:38.839021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049f242-d6f7-4bbf-803d-80b6980295df None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:38.862837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:38.884952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0404a-a6d5-4714-a645-ba19a89d29c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:38.885921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0404a-a6d5-4714-a645-ba19a89d29c8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:38.886421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0404a-a6d5-4714-a645-ba19a89d29c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:38.886891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0404a-a6d5-4714-a645-ba19a89d29c8 None admin] PATH_INFO: `/v3/projects/e7cebf42df3d496db8970830cfea66a2` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:38.888273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0404a-a6d5-4714-a645-ba19a89d29c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e7cebf42df3d496db8970830cfea66a2)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:38.889931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0404a-a6d5-4714-a645-ba19a89d29c8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:38.891761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 192/378] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:38 2022] GET /identity/v3/projects/e7cebf42df3d496db8970830cfea66a2 => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:38.897434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e4ed5-a925-435b-abf3-8138d473df62 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:39.037125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:39.044209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e4ed5-a925-435b-abf3-8138d473df62 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:39.079700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637515d5-886b-4579-bec1-db2d0fa63476 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:39.080689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637515d5-886b-4579-bec1-db2d0fa63476 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:39.081241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637515d5-886b-4579-bec1-db2d0fa63476 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:39.083122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 193/379] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:39.089102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4875b-522b-48a4-83bb-7b3c41c78ade None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:39.089746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4875b-522b-48a4-83bb-7b3c41c78ade None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:39.090093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8768fcc-7666-4f12-9ec5-32ed0b6747f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:39.090470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4875b-522b-48a4-83bb-7b3c41c78ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:39.090735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8768fcc-7666-4f12-9ec5-32ed0b6747f0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:39.091015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8768fcc-7666-4f12-9ec5-32ed0b6747f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:39.091288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8768fcc-7666-4f12-9ec5-32ed0b6747f0 None admin] PATH_INFO: `/v3/groups/7d28165eac9d4a76ae5d2003a6c05d33` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:39.099852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8768fcc-7666-4f12-9ec5-32ed0b6747f0 None admin] RBAC: Authorizing `identity:get_group(group_id=7d28165eac9d4a76ae5d2003a6c05d33)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:39.101225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8768fcc-7666-4f12-9ec5-32ed0b6747f0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:39.102897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 187/380] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:38 2022] GET /identity/v3/groups/7d28165eac9d4a76ae5d2003a6c05d33 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:39.108551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8768fcc-7666-4f12-9ec5-32ed0b6747f0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:39.112554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-56c4875b-522b-48a4-83bb-7b3c41c78ade None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:39.113994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-56c4875b-522b-48a4-83bb-7b3c41c78ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:39.216458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 194/381] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:39.237228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8768fcc-7666-4f12-9ec5-32ed0b6747f0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:39.275929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18f17e-f376-4186-afcf-a54b55926bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:39.276575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18f17e-f376-4186-afcf-a54b55926bfe None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:39.276861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18f17e-f376-4186-afcf-a54b55926bfe None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:39.277135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18f17e-f376-4186-afcf-a54b55926bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:39.277870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18f17e-f376-4186-afcf-a54b55926bfe None admin] RBAC: Adding query filter params (group.id=7d28165eac9d4a76ae5d2003a6c05d33, role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=e7cebf42df3d496db8970830cfea66a2) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:39.278179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18f17e-f376-4186-afcf-a54b55926bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:39.279783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18f17e-f376-4186-afcf-a54b55926bfe None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:39.285999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 188/382] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:39 2022] GET /identity/v3/role_assignments?group.id=7d28165eac9d4a76ae5d2003a6c05d33&scope.project.id=e7cebf42df3d496db8970830cfea66a2&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:39.610115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4875b-522b-48a4-83bb-7b3c41c78ade None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:39.737321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4875b-522b-48a4-83bb-7b3c41c78ade None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:39.757129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:39.778646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d22aa-ab38-4d2e-8f7f-6d55fd70472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:39.779281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d22aa-ab38-4d2e-8f7f-6d55fd70472e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:39.779564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d22aa-ab38-4d2e-8f7f-6d55fd70472e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:39.779837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d22aa-ab38-4d2e-8f7f-6d55fd70472e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:39.783264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4fe59-e0f1-4459-ba65-d83360ada7c5 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:39.783543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4fe59-e0f1-4459-ba65-d83360ada7c5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:39.783812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4fe59-e0f1-4459-ba65-d83360ada7c5 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:39.785297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 189/383] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:39.799168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d22aa-ab38-4d2e-8f7f-6d55fd70472e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:39.800952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075166-5f08-4893-8285-d679a13bea62 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:39.801455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075166-5f08-4893-8285-d679a13bea62 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:39.802754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7075166-5f08-4893-8285-d679a13bea62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1b7d22aa-ab38-4d2e-8f7f-6d55fd70472e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:39.804969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:39.806007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:39.806834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 195/384] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:39.813666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d22aa-ab38-4d2e-8f7f-6d55fd70472e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:39.840011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a7075166-5f08-4893-8285-d679a13bea62 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:39.841585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a7075166-5f08-4893-8285-d679a13bea62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:39.861973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:39.941713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d22aa-ab38-4d2e-8f7f-6d55fd70472e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:39.969416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 190/385] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:39.979691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:39.980368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:39.980644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:39.980914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:39.981574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:39.981874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:39.983258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:39.992387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 196/386] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:39.998008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7075166-5f08-4893-8285-d679a13bea62 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:40.200603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7075166-5f08-4893-8285-d679a13bea62 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:40.241305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f72ad-3b21-4125-a9f3-8e9647722a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:40.242318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f72ad-3b21-4125-a9f3-8e9647722a88 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:40.242803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f72ad-3b21-4125-a9f3-8e9647722a88 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:40.243288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f72ad-3b21-4125-a9f3-8e9647722a88 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:40.248808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f72ad-3b21-4125-a9f3-8e9647722a88 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:40.250476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f72ad-3b21-4125-a9f3-8e9647722a88 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:40.252574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 191/387] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:39 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:40.258395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:40.262392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f72ad-3b21-4125-a9f3-8e9647722a88 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:40.292924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:40.307179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:40.369306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3358dc-f117-4607-85c4-b6364471b9ff None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:40.407705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1308-e85a-4206-8a29-5c5b7817031a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:40.408365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1308-e85a-4206-8a29-5c5b7817031a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:40.408645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1308-e85a-4206-8a29-5c5b7817031a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:40.408918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf1308-e85a-4206-8a29-5c5b7817031a None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:40.410337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1308-e85a-4206-8a29-5c5b7817031a None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:40.413577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf1308-e85a-4206-8a29-5c5b7817031a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:40.415911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 197/388] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:40 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:40.421650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1308-e85a-4206-8a29-5c5b7817031a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:40.438116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f72ad-3b21-4125-a9f3-8e9647722a88 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:40.517950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c048-be34-4cbd-9d81-1ac518386b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:40.518507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c048-be34-4cbd-9d81-1ac518386b73 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:40.518791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c048-be34-4cbd-9d81-1ac518386b73 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:40.519064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63c048-be34-4cbd-9d81-1ac518386b73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:40.533332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf1308-e85a-4206-8a29-5c5b7817031a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:40.540725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63c048-be34-4cbd-9d81-1ac518386b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ad63c048-be34-4cbd-9d81-1ac518386b73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:40.545776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:40.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:40.547445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 192/389] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:40.548936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:40.559344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c048-be34-4cbd-9d81-1ac518386b73 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:40.577896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e1462-399b-4a3a-a49b-ed878f266f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:40.577896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1462-399b-4a3a-a49b-ed878f266f8b None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:40.578201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1462-399b-4a3a-a49b-ed878f266f8b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:40.578275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1462-399b-4a3a-a49b-ed878f266f8b None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239/groups/31462a4b9a79416ba7ab3efcd9dde2d1/roles/7f637775fa4c48a194ebb4513effa6b9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:40.580474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e1462-399b-4a3a-a49b-ed878f266f8b None admin] RBAC: Authorizing `identity:create_grant(project_id=03aab93361d540d59cc78163f7da6239, group_id=31462a4b9a79416ba7ab3efcd9dde2d1, role_id=7f637775fa4c48a194ebb4513effa6b9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:40.581936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e1462-399b-4a3a-a49b-ed878f266f8b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:40.602597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 198/390] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 31 09:32:40 2022] PUT /identity/v3/projects/03aab93361d540d59cc78163f7da6239/groups/31462a4b9a79416ba7ab3efcd9dde2d1/roles/7f637775fa4c48a194ebb4513effa6b9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:40.604809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02569d-6c32-43f9-873a-2f0dbd0e6912 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:40.604951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02569d-6c32-43f9-873a-2f0dbd0e6912 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:40.605181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02569d-6c32-43f9-873a-2f0dbd0e6912 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:40.607172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 199/391] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:40.616801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb930c2-f4fa-4139-9df1-d0af265d58a4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:40.617248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb930c2-f4fa-4139-9df1-d0af265d58a4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:40.617411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb930c2-f4fa-4139-9df1-d0af265d58a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:40.661266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3cb930c2-f4fa-4139-9df1-d0af265d58a4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:40.663130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3cb930c2-f4fa-4139-9df1-d0af265d58a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:40.731296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:40.755226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63c048-be34-4cbd-9d81-1ac518386b73 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:40.797869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:40.798402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:40.798673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:40.798937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:40.799665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:40.799968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:40.801969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:40.812737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 193/392] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:40.818978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:40.844307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 200/393] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:40.927157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009d241-cbc8-40b0-8846-8a79aa307322 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:40.961928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8db6-fb12-4300-86c2-a7baa287a412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:40.962559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8db6-fb12-4300-86c2-a7baa287a412 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:40.962838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8db6-fb12-4300-86c2-a7baa287a412 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:40.963134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f8db6-fb12-4300-86c2-a7baa287a412 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:40.964343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8db6-fb12-4300-86c2-a7baa287a412 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:40.965773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f8db6-fb12-4300-86c2-a7baa287a412 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:40.967627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 194/394] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:40 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:40.973279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb930c2-f4fa-4139-9df1-d0af265d58a4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:41.085378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:41.089242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb930c2-f4fa-4139-9df1-d0af265d58a4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:41.133796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c148c2e-9057-433e-8459-fbd4c4a2f8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:41.134783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148c2e-9057-433e-8459-fbd4c4a2f8b0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.135278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148c2e-9057-433e-8459-fbd4c4a2f8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.135761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c148c2e-9057-433e-8459-fbd4c4a2f8b0 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.137147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c148c2e-9057-433e-8459-fbd4c4a2f8b0 None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:41.138784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c148c2e-9057-433e-8459-fbd4c4a2f8b0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:41.140634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 201/395] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:40 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:41.149236 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8db6-fb12-4300-86c2-a7baa287a412 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:41.172066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:41.221126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c148c2e-9057-433e-8459-fbd4c4a2f8b0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:41.283705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f8db6-fb12-4300-86c2-a7baa287a412 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:41.321446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e82f1-3add-4016-aad5-6d72f5a75599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:41.322104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e82f1-3add-4016-aad5-6d72f5a75599 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.322378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e82f1-3add-4016-aad5-6d72f5a75599 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.322647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e82f1-3add-4016-aad5-6d72f5a75599 None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239/groups/31462a4b9a79416ba7ab3efcd9dde2d1/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.324964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e82f1-3add-4016-aad5-6d72f5a75599 None admin] RBAC: Authorizing `identity:create_grant(project_id=03aab93361d540d59cc78163f7da6239, group_id=31462a4b9a79416ba7ab3efcd9dde2d1, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:41.326414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e82f1-3add-4016-aad5-6d72f5a75599 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:41.343610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 195/396] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 31 09:32:41 2022] PUT /identity/v3/projects/03aab93361d540d59cc78163f7da6239/groups/31462a4b9a79416ba7ab3efcd9dde2d1/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:41.344890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a565-e5b9-44de-bc13-902c65b223f3 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.345174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a565-e5b9-44de-bc13-902c65b223f3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.345446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266a565-e5b9-44de-bc13-902c65b223f3 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.349312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 196/397] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:41.359890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503169-84b5-479f-8eb5-e0503f33935d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.361583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503169-84b5-479f-8eb5-e0503f33935d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.362737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f503169-84b5-479f-8eb5-e0503f33935d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.404614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8f503169-84b5-479f-8eb5-e0503f33935d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:41.409209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c148c2e-9057-433e-8459-fbd4c4a2f8b0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:41.410079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8f503169-84b5-479f-8eb5-e0503f33935d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:41.480131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c6d96-167a-47ab-b35c-e235e5a4a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:41.480817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c6d96-167a-47ab-b35c-e235e5a4a028 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.481079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c6d96-167a-47ab-b35c-e235e5a4a028 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.481355 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c6d96-167a-47ab-b35c-e235e5a4a028 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.501482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c6d96-167a-47ab-b35c-e235e5a4a028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:41.502246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-512c6d96-167a-47ab-b35c-e235e5a4a028 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:41.508122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:41.509112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:41.509916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:41.515528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 202/398] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:41.516004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 197/399] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:41.518388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c6d96-167a-47ab-b35c-e235e5a4a028 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:41.570831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:41.662924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c6d96-167a-47ab-b35c-e235e5a4a028 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:41.697275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da6842-a569-4808-9611-d8960e3d4c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:41.697884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6842-a569-4808-9611-d8960e3d4c05 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.698412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6842-a569-4808-9611-d8960e3d4c05 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.698688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da6842-a569-4808-9611-d8960e3d4c05 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.699356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da6842-a569-4808-9611-d8960e3d4c05 None admin] RBAC: Adding query filter params (name=member) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:41.699654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da6842-a569-4808-9611-d8960e3d4c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:41.701113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72da6842-a569-4808-9611-d8960e3d4c05 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:41.712297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 203/400] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:41.717976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f503169-84b5-479f-8eb5-e0503f33935d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:41.803856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223944dd-a0bf-48d8-8dec-e7d5113b8ac7 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.804393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223944dd-a0bf-48d8-8dec-e7d5113b8ac7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.804834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223944dd-a0bf-48d8-8dec-e7d5113b8ac7 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.806428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 204/401] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:41.811682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69702-b1dd-45d2-b9a7-fd799e1bc27f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.812150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69702-b1dd-45d2-b9a7-fd799e1bc27f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.812584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb69702-b1dd-45d2-b9a7-fd799e1bc27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.843813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f503169-84b5-479f-8eb5-e0503f33935d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:41.852621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-afb69702-b1dd-45d2-b9a7-fd799e1bc27f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:41.854191 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-afb69702-b1dd-45d2-b9a7-fd799e1bc27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:41.880622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78eab2-9f4a-4368-876a-2ac80e23df7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:41.881333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78eab2-9f4a-4368-876a-2ac80e23df7a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:41.881646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78eab2-9f4a-4368-876a-2ac80e23df7a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:41.881924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78eab2-9f4a-4368-876a-2ac80e23df7a None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:41.883060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78eab2-9f4a-4368-876a-2ac80e23df7a None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:41.884532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78eab2-9f4a-4368-876a-2ac80e23df7a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:41.890779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 198/402] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:41 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:41.891636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78eab2-9f4a-4368-876a-2ac80e23df7a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:41.933044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 205/403] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:41.934266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb69702-b1dd-45d2-b9a7-fd799e1bc27f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:41.954251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:41.984573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:42.005000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78eab2-9f4a-4368-876a-2ac80e23df7a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.044926 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507155c8-1b27-4c44-8232-1738be1f4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.045565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507155c8-1b27-4c44-8232-1738be1f4708 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.045846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507155c8-1b27-4c44-8232-1738be1f4708 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.046122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507155c8-1b27-4c44-8232-1738be1f4708 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.059101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507155c8-1b27-4c44-8232-1738be1f4708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-507155c8-1b27-4c44-8232-1738be1f4708 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:42.064841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:42.065707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:42.067011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 199/404] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:42.072549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507155c8-1b27-4c44-8232-1738be1f4708 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:42.118475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb69702-b1dd-45d2-b9a7-fd799e1bc27f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.184598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c5b55-e4d3-4edc-ac37-c85d1e482204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.185674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5b55-e4d3-4edc-ac37-c85d1e482204 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.186164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5b55-e4d3-4edc-ac37-c85d1e482204 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.186633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c5b55-e4d3-4edc-ac37-c85d1e482204 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.189954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c5b55-e4d3-4edc-ac37-c85d1e482204 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:42.191093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507155c8-1b27-4c44-8232-1738be1f4708 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.191916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c5b55-e4d3-4edc-ac37-c85d1e482204 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:42.194008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 206/405] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:41 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:42.205414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c5b55-e4d3-4edc-ac37-c85d1e482204 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:42.234323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:42.239201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.239837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.240388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.240720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.242038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:42.242445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:42.243959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:42.258824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 200/406] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:42.281906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:42.342837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:42.359600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c5b55-e4d3-4edc-ac37-c85d1e482204 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.396964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce60c8-982a-4055-918e-df8b3a51b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.397629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce60c8-982a-4055-918e-df8b3a51b1d7 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.397907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce60c8-982a-4055-918e-df8b3a51b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.398195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce60c8-982a-4055-918e-df8b3a51b1d7 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/groups/31462a4b9a79416ba7ab3efcd9dde2d1/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.400116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce60c8-982a-4055-918e-df8b3a51b1d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6527faef0be04d66bdf6fed5305c5dc9, group_id=31462a4b9a79416ba7ab3efcd9dde2d1, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:42.401609 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce60c8-982a-4055-918e-df8b3a51b1d7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:42.428200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 207/407] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 31 09:32:42 2022] PUT /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/groups/31462a4b9a79416ba7ab3efcd9dde2d1/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:32:42.428200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce60c8-982a-4055-918e-df8b3a51b1d7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:42.428872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1837c-6ce1-4045-80bf-17d2f63b736a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.512614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd17a1-6078-46ea-b1e8-891449fcb239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.513176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd17a1-6078-46ea-b1e8-891449fcb239 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.513454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd17a1-6078-46ea-b1e8-891449fcb239 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.515871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd17a1-6078-46ea-b1e8-891449fcb239 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.518765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd17a1-6078-46ea-b1e8-891449fcb239 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:42.522321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd17a1-6078-46ea-b1e8-891449fcb239 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:42.527386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 201/408] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:42 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:42.532521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd17a1-6078-46ea-b1e8-891449fcb239 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:42.608350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:42.632689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce60c8-982a-4055-918e-df8b3a51b1d7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.667339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd17a1-6078-46ea-b1e8-891449fcb239 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.680108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6856b-c12a-41ec-87b3-384fc84fa8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.680783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6856b-c12a-41ec-87b3-384fc84fa8ad None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.681067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6856b-c12a-41ec-87b3-384fc84fa8ad None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.681345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6856b-c12a-41ec-87b3-384fc84fa8ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.695511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6856b-c12a-41ec-87b3-384fc84fa8ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e4a6856b-c12a-41ec-87b3-384fc84fa8ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:42.701992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:42.702872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:42.703647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 208/409] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:42.709671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6856b-c12a-41ec-87b3-384fc84fa8ad None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:42.713897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8e961-10b7-4d52-a456-b8f53e227556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.715696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e961-10b7-4d52-a456-b8f53e227556 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.716418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e961-10b7-4d52-a456-b8f53e227556 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.717172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad8e961-10b7-4d52-a456-b8f53e227556 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.719789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e961-10b7-4d52-a456-b8f53e227556 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:42.721645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad8e961-10b7-4d52-a456-b8f53e227556 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:42.725255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 202/410] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:42 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:42.730356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:42.731571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8e961-10b7-4d52-a456-b8f53e227556 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:42.845912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad8e961-10b7-4d52-a456-b8f53e227556 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.861668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6856b-c12a-41ec-87b3-384fc84fa8ad None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:42.881841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a06672-5333-447c-a773-39015269523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.882276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a06672-5333-447c-a773-39015269523b None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.882598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a06672-5333-447c-a773-39015269523b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.882871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a06672-5333-447c-a773-39015269523b None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/groups/31462a4b9a79416ba7ab3efcd9dde2d1/roles/7f637775fa4c48a194ebb4513effa6b9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.885226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a06672-5333-447c-a773-39015269523b None admin] RBAC: Authorizing `identity:create_grant(project_id=6527faef0be04d66bdf6fed5305c5dc9, group_id=31462a4b9a79416ba7ab3efcd9dde2d1, role_id=7f637775fa4c48a194ebb4513effa6b9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:42.886738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a06672-5333-447c-a773-39015269523b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:42.892578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:42.915751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 203/411] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 31 09:32:42 2022] PUT /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9/groups/31462a4b9a79416ba7ab3efcd9dde2d1/roles/7f637775fa4c48a194ebb4513effa6b9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:42.928445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536574da-700e-4752-a212-24f9938a491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:42.929141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536574da-700e-4752-a212-24f9938a491c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.929423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536574da-700e-4752-a212-24f9938a491c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.929700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536574da-700e-4752-a212-24f9938a491c None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.930450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536574da-700e-4752-a212-24f9938a491c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:42.930815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536574da-700e-4752-a212-24f9938a491c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:42.932402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536574da-700e-4752-a212-24f9938a491c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:42.944156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7f7bd-16ec-4230-83cc-ab082de997eb None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.944507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7f7bd-16ec-4230-83cc-ab082de997eb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.944788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa7f7bd-16ec-4230-83cc-ab082de997eb None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.946171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 204/412] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:42.954610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 209/413] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:42.957263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e17c0-0722-47bd-b6ba-f84b533e9e24 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:42.957413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e17c0-0722-47bd-b6ba-f84b533e9e24 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:42.957589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e17c0-0722-47bd-b6ba-f84b533e9e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:42.963562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536574da-700e-4752-a212-24f9938a491c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:42.993801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-923e17c0-0722-47bd-b6ba-f84b533e9e24 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:42.996818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-923e17c0-0722-47bd-b6ba-f84b533e9e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:43.071249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:43.110143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536574da-700e-4752-a212-24f9938a491c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:43.147639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e93f6-0d95-4a39-bc34-136acccf9dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:43.148653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e93f6-0d95-4a39-bc34-136acccf9dfb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:43.148863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 205/414] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:43.149343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e93f6-0d95-4a39-bc34-136acccf9dfb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:43.149806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e93f6-0d95-4a39-bc34-136acccf9dfb None admin] PATH_INFO: `/v3/groups/7d28165eac9d4a76ae5d2003a6c05d33` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:43.153633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e93f6-0d95-4a39-bc34-136acccf9dfb None admin] RBAC: Authorizing `identity:get_group(group_id=7d28165eac9d4a76ae5d2003a6c05d33)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:43.155330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e93f6-0d95-4a39-bc34-136acccf9dfb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:43.157266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 210/415] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:42 2022] GET /identity/v3/groups/7d28165eac9d4a76ae5d2003a6c05d33 => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:43.163546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e17c0-0722-47bd-b6ba-f84b533e9e24 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:43.291891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e17c0-0722-47bd-b6ba-f84b533e9e24 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:43.313611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:43.339376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f082a-defb-42dc-8f7a-9fe2df75280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:43.340010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f082a-defb-42dc-8f7a-9fe2df75280e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:43.340318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f082a-defb-42dc-8f7a-9fe2df75280e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:43.340589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730f082a-defb-42dc-8f7a-9fe2df75280e None admin] PATH_INFO: `/v3/projects/e7cebf42df3d496db8970830cfea66a2` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:43.344853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f082a-defb-42dc-8f7a-9fe2df75280e None admin] RBAC: Authorizing `identity:get_project(project_id=e7cebf42df3d496db8970830cfea66a2)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:43.346284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730f082a-defb-42dc-8f7a-9fe2df75280e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:43.348316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 206/416] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:43 2022] GET /identity/v3/projects/e7cebf42df3d496db8970830cfea66a2 => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:43.353851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e93f6-0d95-4a39-bc34-136acccf9dfb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:43.492375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f082a-defb-42dc-8f7a-9fe2df75280e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:43.500510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e93f6-0d95-4a39-bc34-136acccf9dfb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:43.543080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f8553-43a8-4194-a660-5ab197d6f804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:43.545393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f8553-43a8-4194-a660-5ab197d6f804 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:43.546747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f8553-43a8-4194-a660-5ab197d6f804 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:43.547277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f8553-43a8-4194-a660-5ab197d6f804 None admin] PATH_INFO: `/v3/projects/e7cebf42df3d496db8970830cfea66a2/groups/7d28165eac9d4a76ae5d2003a6c05d33/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:43.549941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f8553-43a8-4194-a660-5ab197d6f804 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7cebf42df3d496db8970830cfea66a2, group_id=7d28165eac9d4a76ae5d2003a6c05d33, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:43.551653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f8553-43a8-4194-a660-5ab197d6f804 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:43.555645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:43.588832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 211/417] 10.222.0.18 () {58 vars in 1442 bytes} [Wed Aug 31 09:32:43 2022] PUT /identity/v3/projects/e7cebf42df3d496db8970830cfea66a2/groups/7d28165eac9d4a76ae5d2003a6c05d33/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:32:43.646937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730f082a-defb-42dc-8f7a-9fe2df75280e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:43.685817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c8acb-1c07-4be6-a45f-5db72dc74eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:43.686832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c8acb-1c07-4be6-a45f-5db72dc74eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:43.687299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c8acb-1c07-4be6-a45f-5db72dc74eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:43.687795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c8acb-1c07-4be6-a45f-5db72dc74eb6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:43.700644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c8acb-1c07-4be6-a45f-5db72dc74eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c59c8acb-1c07-4be6-a45f-5db72dc74eb6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:43.706734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:43.707667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:43.708504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:43.711134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 207/418] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:43.717139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f8553-43a8-4194-a660-5ab197d6f804 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:43.780523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b9a38-6c58-48e4-b18e-37ed3e6663e6 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:43.780712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b9a38-6c58-48e4-b18e-37ed3e6663e6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:43.780982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b9a38-6c58-48e4-b18e-37ed3e6663e6 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:43.782801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 208/419] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:43.788996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d64c-7033-4b6d-aa38-1dd3cc4c2429 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:43.789283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d64c-7033-4b6d-aa38-1dd3cc4c2429 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:43.789564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64d64c-7033-4b6d-aa38-1dd3cc4c2429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:43.825842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4c64d64c-7033-4b6d-aa38-1dd3cc4c2429 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:43.827070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4c64d64c-7033-4b6d-aa38-1dd3cc4c2429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:43.885499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f8553-43a8-4194-a660-5ab197d6f804 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:43.904720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:43.923952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:43.925388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:43.925498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:43.925724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:43.926381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:43.926686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:43.928082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:43.936555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 212/420] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:43.942655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:43.943564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 209/421] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:44.039651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:44.092589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfaa4b-1cc6-4b22-b17b-10d35ec34cf6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:44.140840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e3de4-1b01-4e84-b9c8-20ad2064cc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:44.141443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e3de4-1b01-4e84-b9c8-20ad2064cc13 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:44.141724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e3de4-1b01-4e84-b9c8-20ad2064cc13 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:44.141993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e3de4-1b01-4e84-b9c8-20ad2064cc13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:44.237751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e3de4-1b01-4e84-b9c8-20ad2064cc13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:44.239568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e3de4-1b01-4e84-b9c8-20ad2064cc13 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:44.300081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:44.347481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 213/422] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:44.353153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64d64c-7033-4b6d-aa38-1dd3cc4c2429 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:44.366348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e3de4-1b01-4e84-b9c8-20ad2064cc13 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:44.527590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e3de4-1b01-4e84-b9c8-20ad2064cc13 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:44.539663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64d64c-7033-4b6d-aa38-1dd3cc4c2429 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:44.568516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ecbb8-f669-45c2-96b5-6a62ad38dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:44.568516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ecbb8-f669-45c2-96b5-6a62ad38dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:44.568516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ecbb8-f669-45c2-96b5-6a62ad38dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:44.568516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ecbb8-f669-45c2-96b5-6a62ad38dbd6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:44.590857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ecbb8-f669-45c2-96b5-6a62ad38dbd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-0f6ecbb8-f669-45c2-96b5-6a62ad38dbd6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:44.598530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:44.599452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:44.600260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 214/423] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:44.608000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba702-c57a-462b-a76a-27f20e43e75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:44.608677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba702-c57a-462b-a76a-27f20e43e75c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:44.608957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba702-c57a-462b-a76a-27f20e43e75c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:44.609227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba702-c57a-462b-a76a-27f20e43e75c None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:44.610359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba702-c57a-462b-a76a-27f20e43e75c None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:44.612405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0ba702-c57a-462b-a76a-27f20e43e75c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:44.614412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 210/424] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:44 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:44.619771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ecbb8-f669-45c2-96b5-6a62ad38dbd6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:44.626747 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba702-c57a-462b-a76a-27f20e43e75c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:44.656304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:44.718652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:44.805656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ba702-c57a-462b-a76a-27f20e43e75c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:44.828953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ecbb8-f669-45c2-96b5-6a62ad38dbd6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:44.848794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff50634-fe6c-4e46-a91f-52dfd4bc0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:44.849417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff50634-fe6c-4e46-a91f-52dfd4bc0785 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:44.849697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff50634-fe6c-4e46-a91f-52dfd4bc0785 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:44.849970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff50634-fe6c-4e46-a91f-52dfd4bc0785 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:44.850645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff50634-fe6c-4e46-a91f-52dfd4bc0785 None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:44.850950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff50634-fe6c-4e46-a91f-52dfd4bc0785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:44.852849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff50634-fe6c-4e46-a91f-52dfd4bc0785 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:44.864519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 211/425] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:44.868327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa31c8d-126d-47c5-bf8d-d98a8f4c71f7 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:44.868843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa31c8d-126d-47c5-bf8d-d98a8f4c71f7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:44.869318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa31c8d-126d-47c5-bf8d-d98a8f4c71f7 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:44.871481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 212/426] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:44.871692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718d4dc-ecb7-440a-b8cc-28f76c4e8ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:44.872420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d4dc-ecb7-440a-b8cc-28f76c4e8ee1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:44.872708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d4dc-ecb7-440a-b8cc-28f76c4e8ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:44.872983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d4dc-ecb7-440a-b8cc-28f76c4e8ee1 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:44.873397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa31c8d-126d-47c5-bf8d-d98a8f4c71f7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:44.875955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d4dc-ecb7-440a-b8cc-28f76c4e8ee1 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:44.878021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d4dc-ecb7-440a-b8cc-28f76c4e8ee1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:44.879939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 215/427] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:44 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:44.884008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477bc47-6316-4112-8b0b-314efc24c542 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:44.884008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477bc47-6316-4112-8b0b-314efc24c542 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:44.884008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477bc47-6316-4112-8b0b-314efc24c542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:44.903178 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6477bc47-6316-4112-8b0b-314efc24c542 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:44.904411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6477bc47-6316-4112-8b0b-314efc24c542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:44.976684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 216/428] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:44.980233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477bc47-6316-4112-8b0b-314efc24c542 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:44.995416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:44.997213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa31c8d-126d-47c5-bf8d-d98a8f4c71f7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:45.004199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:45.061690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e95a0-df47-4903-85a9-1e5140aa1741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:45.062308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e95a0-df47-4903-85a9-1e5140aa1741 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.062588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e95a0-df47-4903-85a9-1e5140aa1741 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.062862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e95a0-df47-4903-85a9-1e5140aa1741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.147047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477bc47-6316-4112-8b0b-314efc24c542 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:45.209227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e95a0-df47-4903-85a9-1e5140aa1741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:45.211265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e95a0-df47-4903-85a9-1e5140aa1741 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:45.215001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c2d59-e0bd-4081-ab15-13a2d66649f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:45.215614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2d59-e0bd-4081-ab15-13a2d66649f8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.215893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2d59-e0bd-4081-ab15-13a2d66649f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.216163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c2d59-e0bd-4081-ab15-13a2d66649f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.216910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c2d59-e0bd-4081-ab15-13a2d66649f8 None admin] RBAC: Adding query filter params (group.id=31462a4b9a79416ba7ab3efcd9dde2d1, role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=03aab93361d540d59cc78163f7da6239) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:45.217218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c2d59-e0bd-4081-ab15-13a2d66649f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:45.218663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c2d59-e0bd-4081-ab15-13a2d66649f8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:45.239044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 217/429] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:44 2022] GET /identity/v3/role_assignments?group.id=31462a4b9a79416ba7ab3efcd9dde2d1&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 611 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:45.268873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5034-9683-43fb-b3c8-4cd188ff29c0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.269209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5034-9683-43fb-b3c8-4cd188ff29c0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.269415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38f5034-9683-43fb-b3c8-4cd188ff29c0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.270821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 218/430] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:45.277200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ca08-4749-49c2-9a82-517a89fc72a1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.277494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ca08-4749-49c2-9a82-517a89fc72a1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.277752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3ca08-4749-49c2-9a82-517a89fc72a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.317293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8be3ca08-4749-49c2-9a82-517a89fc72a1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:45.318510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8be3ca08-4749-49c2-9a82-517a89fc72a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:45.355413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 213/431] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:45.356288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e95a0-df47-4903-85a9-1e5140aa1741 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:45.359639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:45.400442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 219/432] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:45.401354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3ca08-4749-49c2-9a82-517a89fc72a1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:45.414470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:45.476028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e95a0-df47-4903-85a9-1e5140aa1741 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:45.513346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3ca08-4749-49c2-9a82-517a89fc72a1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:45.517125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614baeae-0d0a-4281-80ba-176c7782be4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:45.518603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614baeae-0d0a-4281-80ba-176c7782be4f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.519079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614baeae-0d0a-4281-80ba-176c7782be4f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.519545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614baeae-0d0a-4281-80ba-176c7782be4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.532923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614baeae-0d0a-4281-80ba-176c7782be4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-614baeae-0d0a-4281-80ba-176c7782be4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:45.539840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:45.541214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 09:32:45.541983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:45.544702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 214/433] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:45.552222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614baeae-0d0a-4281-80ba-176c7782be4f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:45.558301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d261-50cb-417d-b452-e54be6ac3bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:45.558947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d261-50cb-417d-b452-e54be6ac3bcb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.559229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d261-50cb-417d-b452-e54be6ac3bcb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.559506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073d261-50cb-417d-b452-e54be6ac3bcb None admin] PATH_INFO: `/v3/projects/03aab93361d540d59cc78163f7da6239` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.560712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073d261-50cb-417d-b452-e54be6ac3bcb None admin] RBAC: Authorizing `identity:get_project(project_id=03aab93361d540d59cc78163f7da6239)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:45.562314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073d261-50cb-417d-b452-e54be6ac3bcb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:45.566747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 220/434] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:45 2022] GET /identity/v3/projects/03aab93361d540d59cc78163f7da6239 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:45.577326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d261-50cb-417d-b452-e54be6ac3bcb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:45.637195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:45.675418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:45.692288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614baeae-0d0a-4281-80ba-176c7782be4f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:45.703995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073d261-50cb-417d-b452-e54be6ac3bcb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:45.740508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:45.741622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.742048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.742490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.743968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] RBAC: Adding query filter params (name=member) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:45.744524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:45.746361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:45.753613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c10f8e-9a12-4dec-a804-04ab6539f359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:45.754346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c10f8e-9a12-4dec-a804-04ab6539f359 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.754702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c10f8e-9a12-4dec-a804-04ab6539f359 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.755053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c10f8e-9a12-4dec-a804-04ab6539f359 None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.756279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c10f8e-9a12-4dec-a804-04ab6539f359 None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:45.757800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c10f8e-9a12-4dec-a804-04ab6539f359 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:45.758625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 215/435] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:32:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:45.761454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 221/436] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:45 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:45.764517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:45.765713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c10f8e-9a12-4dec-a804-04ab6539f359 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:45.873506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c10f8e-9a12-4dec-a804-04ab6539f359 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:45.873828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77341ab-6ed7-428e-8c10-f166fa47319c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:45.901651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:45.912412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac53a72-b828-43fa-9fc6-042f1ad295f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:45.912898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52274b21-5ae4-45e1-8470-5c8686a7d922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:45.913016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53a72-b828-43fa-9fc6-042f1ad295f9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.913299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53a72-b828-43fa-9fc6-042f1ad295f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.913521 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52274b21-5ae4-45e1-8470-5c8686a7d922 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:45.913628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac53a72-b828-43fa-9fc6-042f1ad295f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.913797 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52274b21-5ae4-45e1-8470-5c8686a7d922 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:45.914179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52274b21-5ae4-45e1-8470-5c8686a7d922 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:45.927717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52274b21-5ae4-45e1-8470-5c8686a7d922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-52274b21-5ae4-45e1-8470-5c8686a7d922 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:45.933239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:45.934097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:45.934884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:45.939134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 222/437] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:45.940408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52274b21-5ae4-45e1-8470-5c8686a7d922 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:45.950384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:45.990101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac53a72-b828-43fa-9fc6-042f1ad295f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:45.991631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac53a72-b828-43fa-9fc6-042f1ad295f9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:46.047315 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52274b21-5ae4-45e1-8470-5c8686a7d922 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:46.081750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:46.082352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.082636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.082911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.083630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] RBAC: Adding query filter params (group.id=31462a4b9a79416ba7ab3efcd9dde2d1, role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=03aab93361d540d59cc78163f7da6239) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:46.083939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:46.085442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:46.091090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 223/438] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:45 2022] GET /identity/v3/role_assignments?group.id=31462a4b9a79416ba7ab3efcd9dde2d1&scope.project.id=03aab93361d540d59cc78163f7da6239&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:46.096544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 216/439] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:46.096728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:46.096806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773b4f-03e4-47be-85b2-86e2edc5f132 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.096806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773b4f-03e4-47be-85b2-86e2edc5f132 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.096806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08773b4f-03e4-47be-85b2-86e2edc5f132 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.096806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 217/440] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:46.100008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773b4f-03e4-47be-85b2-86e2edc5f132 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:46.135059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:46.185444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:46.221402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d4018-e433-4db1-8b33-b6d6a3ce0141 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:46.224880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08773b4f-03e4-47be-85b2-86e2edc5f132 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:46.264629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:46.265242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.265523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.265798 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.266466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:46.266797 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:46.268916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:46.269085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b6e26-e32d-46d6-bfe9-005ee8143848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:46.269573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b6e26-e32d-46d6-bfe9-005ee8143848 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.269847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b6e26-e32d-46d6-bfe9-005ee8143848 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.270116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b6e26-e32d-46d6-bfe9-005ee8143848 None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.271230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b6e26-e32d-46d6-bfe9-005ee8143848 None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:46.272689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b6e26-e32d-46d6-bfe9-005ee8143848 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:46.274316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 218/441] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:46.275538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5acb44-fc14-4aef-bfad-03e98981b693 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.275881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5acb44-fc14-4aef-bfad-03e98981b693 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.276159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5acb44-fc14-4aef-bfad-03e98981b693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.279477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 224/442] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:46.281008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:46.299230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4f5acb44-fc14-4aef-bfad-03e98981b693 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:46.300443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4f5acb44-fc14-4aef-bfad-03e98981b693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:46.384895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 219/443] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:46.384895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5acb44-fc14-4aef-bfad-03e98981b693 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:46.399022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d460fa2-dd5b-4887-92ce-b00111b3c6b7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:46.417270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:46.440520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:46.451995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ae06f-ad3f-4109-9271-6cb8e95cc8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:46.452888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ae06f-ad3f-4109-9271-6cb8e95cc8fb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.453307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ae06f-ad3f-4109-9271-6cb8e95cc8fb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.453717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ae06f-ad3f-4109-9271-6cb8e95cc8fb None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.455698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ae06f-ad3f-4109-9271-6cb8e95cc8fb None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:46.457450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25ae06f-ad3f-4109-9271-6cb8e95cc8fb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:46.459227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 225/444] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:46.465406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ae06f-ad3f-4109-9271-6cb8e95cc8fb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:46.523621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5acb44-fc14-4aef-bfad-03e98981b693 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:46.565113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b255-81fc-493b-b51a-9f863ff696e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:46.565751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b255-81fc-493b-b51a-9f863ff696e2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.565976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b255-81fc-493b-b51a-9f863ff696e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.566243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81b255-81fc-493b-b51a-9f863ff696e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.608681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ae06f-ad3f-4109-9271-6cb8e95cc8fb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:46.650045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81b255-81fc-493b-b51a-9f863ff696e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:46.651493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d81b255-81fc-493b-b51a-9f863ff696e2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:46.659071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:46.659684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.660673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.661101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.665261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] RBAC: Adding query filter params (group.id=31462a4b9a79416ba7ab3efcd9dde2d1, role.id=9e6ef43d2e734ecf9618ade2aab3ec3a, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:46.665261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:46.666272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:46.677305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 226/445] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/role_assignments?group.id=31462a4b9a79416ba7ab3efcd9dde2d1&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=9e6ef43d2e734ecf9618ade2aab3ec3a => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:46.680602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:46.682430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:46.773354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:46.797856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 220/446] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:46.804981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b255-81fc-493b-b51a-9f863ff696e2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:46.831114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6cf29-3f42-4b4a-9154-a7f864c9340b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:46.874471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acba0e0-7dd7-469e-9835-f77a27840077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:46.875106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acba0e0-7dd7-469e-9835-f77a27840077 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.875466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acba0e0-7dd7-469e-9835-f77a27840077 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.875659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acba0e0-7dd7-469e-9835-f77a27840077 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.890595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acba0e0-7dd7-469e-9835-f77a27840077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6acba0e0-7dd7-469e-9835-f77a27840077 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:46.895536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:46.896458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:46.897272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 227/447] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:46.902726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acba0e0-7dd7-469e-9835-f77a27840077 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:46.932921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81b255-81fc-493b-b51a-9f863ff696e2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:46.961171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:46.977956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693156-532a-4345-83af-0dc3a80c129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:46.978516 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693156-532a-4345-83af-0dc3a80c129c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:46.978795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693156-532a-4345-83af-0dc3a80c129c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:46.979066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693156-532a-4345-83af-0dc3a80c129c None admin] PATH_INFO: `/v3/projects/6527faef0be04d66bdf6fed5305c5dc9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:46.980682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00693156-532a-4345-83af-0dc3a80c129c None admin] RBAC: Authorizing `identity:get_project(project_id=6527faef0be04d66bdf6fed5305c5dc9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:46.981734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00693156-532a-4345-83af-0dc3a80c129c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:46.983366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 221/448] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/projects/6527faef0be04d66bdf6fed5305c5dc9 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:46.989829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693156-532a-4345-83af-0dc3a80c129c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:47.017308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acba0e0-7dd7-469e-9835-f77a27840077 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:47.042944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:47.056907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:47.057506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:47.058346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:47.058346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:47.058688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:47.058984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:47.061376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:47.070703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 228/449] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:47.076621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:47.106488 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693156-532a-4345-83af-0dc3a80c129c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:47.142855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862abbfc-6007-47d3-902b-34fa9822bd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:47.144500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abbfc-6007-47d3-902b-34fa9822bd4a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:47.144789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abbfc-6007-47d3-902b-34fa9822bd4a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:47.145479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862abbfc-6007-47d3-902b-34fa9822bd4a None admin] PATH_INFO: `/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:47.146664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862abbfc-6007-47d3-902b-34fa9822bd4a None admin] RBAC: Authorizing `identity:get_group(group_id=31462a4b9a79416ba7ab3efcd9dde2d1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:47.150953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862abbfc-6007-47d3-902b-34fa9822bd4a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:47.152843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 222/450] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:46 2022] GET /identity/v3/groups/31462a4b9a79416ba7ab3efcd9dde2d1 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:47.159212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862abbfc-6007-47d3-902b-34fa9822bd4a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:47.179845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39a53c-66af-4429-81b1-f618b24027d8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:47.213438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad02a5-a14a-4969-829f-4d1de4813c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:47.214036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad02a5-a14a-4969-829f-4d1de4813c1d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:47.214323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad02a5-a14a-4969-829f-4d1de4813c1d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:47.214593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad02a5-a14a-4969-829f-4d1de4813c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:47.219185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:47.260876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862abbfc-6007-47d3-902b-34fa9822bd4a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:47.267578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:47.281551 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad02a5-a14a-4969-829f-4d1de4813c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:47.283552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad02a5-a14a-4969-829f-4d1de4813c1d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:47.297256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:47.297884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:47.298877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:47.299012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:47.299830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] RBAC: Adding query filter params (group.id=31462a4b9a79416ba7ab3efcd9dde2d1, role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=6527faef0be04d66bdf6fed5305c5dc9) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:47.300141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:47.301590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:47.307220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 223/451] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:47 2022] GET /identity/v3/role_assignments?group.id=31462a4b9a79416ba7ab3efcd9dde2d1&scope.project.id=6527faef0be04d66bdf6fed5305c5dc9&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:47.387194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 229/452] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 09:32:47.393303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:47.496690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e6889-c583-4fc8-9868-7c6d7e937d2b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:47.520079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:47.531475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39092-8e16-4591-9453-d4d499a2c963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:47.532124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39092-8e16-4591-9453-d4d499a2c963 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:47.533053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39092-8e16-4591-9453-d4d499a2c963 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:47.533303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39092-8e16-4591-9453-d4d499a2c963 None admin] PATH_INFO: `/v3/projects/e7cebf42df3d496db8970830cfea66a2` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:47.534474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe39092-8e16-4591-9453-d4d499a2c963 None admin] RBAC: Authorizing `identity:get_project(project_id=e7cebf42df3d496db8970830cfea66a2)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:47.535908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe39092-8e16-4591-9453-d4d499a2c963 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:47.537889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 224/453] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:32:47 2022] GET /identity/v3/projects/e7cebf42df3d496db8970830cfea66a2 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:32:47.543363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad02a5-a14a-4969-829f-4d1de4813c1d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:47.635155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:47.650279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad02a5-a14a-4969-829f-4d1de4813c1d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:47.684194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949f7cfe-4104-4546-a666-3f1d9777df53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:47.684817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7cfe-4104-4546-a666-3f1d9777df53 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:47.685104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7cfe-4104-4546-a666-3f1d9777df53 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:47.685380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949f7cfe-4104-4546-a666-3f1d9777df53 None admin] PATH_INFO: `/v3/groups/7d28165eac9d4a76ae5d2003a6c05d33` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:47.686478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f7cfe-4104-4546-a666-3f1d9777df53 None admin] RBAC: Authorizing `identity:get_group(group_id=7d28165eac9d4a76ae5d2003a6c05d33)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:47.687923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949f7cfe-4104-4546-a666-3f1d9777df53 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:47.690204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 230/454] 10.222.0.18 () {56 vars in 1180 bytes} [Wed Aug 31 09:32:47 2022] GET /identity/v3/groups/7d28165eac9d4a76ae5d2003a6c05d33 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:47.696323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39092-8e16-4591-9453-d4d499a2c963 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:47.792825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39092-8e16-4591-9453-d4d499a2c963 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:47.826114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37367-79a6-4bf9-bb55-8268a7579fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:47.826706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37367-79a6-4bf9-bb55-8268a7579fbd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:47.826982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37367-79a6-4bf9-bb55-8268a7579fbd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:47.827248 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37367-79a6-4bf9-bb55-8268a7579fbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:47.827954 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d37367-79a6-4bf9-bb55-8268a7579fbd None admin] RBAC: Adding query filter params (group.id=7d28165eac9d4a76ae5d2003a6c05d33, role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=e7cebf42df3d496db8970830cfea66a2) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:47.828282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d37367-79a6-4bf9-bb55-8268a7579fbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:47.829743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d37367-79a6-4bf9-bb55-8268a7579fbd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:47.835269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 225/455] 10.222.0.18 () {56 vars in 1376 bytes} [Wed Aug 31 09:32:47 2022] GET /identity/v3/role_assignments?group.id=7d28165eac9d4a76ae5d2003a6c05d33&scope.project.id=e7cebf42df3d496db8970830cfea66a2&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:50.110614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3da2-82a3-49a3-b9de-322ec8dd9a8a None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:50.111144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3da2-82a3-49a3-b9de-322ec8dd9a8a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:50.111144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0d3da2-82a3-49a3-b9de-322ec8dd9a8a None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:50.112803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 231/456] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:50.122130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2f51f-51e1-4610-b616-ca01921fc92f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:50.122919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2f51f-51e1-4610-b616-ca01921fc92f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:50.123366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2f51f-51e1-4610-b616-ca01921fc92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:50.153191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5fb2f51f-51e1-4610-b616-ca01921fc92f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:50.154632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5fb2f51f-51e1-4610-b616-ca01921fc92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:50.219374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:50.245811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 226/457] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:50.266434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f153a5-34e5-40d5-92a7-9777208cbf76 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:50.266962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f153a5-34e5-40d5-92a7-9777208cbf76 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:50.267384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f153a5-34e5-40d5-92a7-9777208cbf76 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:50.268969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 232/458] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:50.274312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f507c7-d75c-410b-a733-937fd9faf82d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:50.274832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f507c7-d75c-410b-a733-937fd9faf82d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:50.275345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f507c7-d75c-410b-a733-937fd9faf82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:50.301210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-39f507c7-d75c-410b-a733-937fd9faf82d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:50.302723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-39f507c7-d75c-410b-a733-937fd9faf82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:50.397870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 227/459] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:50.585782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319abf57-2bcc-4c1a-874f-2e4a420eb9b5 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:50.586430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319abf57-2bcc-4c1a-874f-2e4a420eb9b5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:50.586917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319abf57-2bcc-4c1a-874f-2e4a420eb9b5 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:50.588481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 233/460] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:50.593558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034ffd-048c-496e-b50f-5233db1ac58d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:50.594009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034ffd-048c-496e-b50f-5233db1ac58d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:50.594301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2034ffd-048c-496e-b50f-5233db1ac58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:50.600135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319abf57-2bcc-4c1a-874f-2e4a420eb9b5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:50.618174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c2034ffd-048c-496e-b50f-5233db1ac58d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:50.619358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c2034ffd-048c-496e-b50f-5233db1ac58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:50.732563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 228/461] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:50.734339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034ffd-048c-496e-b50f-5233db1ac58d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:50.750775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319abf57-2bcc-4c1a-874f-2e4a420eb9b5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:50.804566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:50.822296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:50.822935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:50.823236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:50.823496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:50.844965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:50.846553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:50.875412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:50.876426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:50.877278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:50.877278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:50.877278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:50.881226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 234/462] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:50.887397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:50.909498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2034ffd-048c-496e-b50f-5233db1ac58d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:50.911803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:50.960970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:50.961681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:50.961963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:50.962231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:50.982385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:50.983802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:51.009431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:51.010368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:51.011265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:51.011265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:51.011265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:51.011265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 229/463] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:51.017055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:51.048409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be857818-db67-4a89-b025-82911fe746d8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:51.088834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:51.089453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.089734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.090010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.090675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:51.090977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:51.092432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:51.105537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 235/464] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:51.106580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:51.132022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:51.137197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e0ada-be11-4f2d-bb69-2cc7defb5396 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:51.174460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c2354-4935-4161-a226-13df5d24bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:51.175134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c2354-4935-4161-a226-13df5d24bd54 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.175417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c2354-4935-4161-a226-13df5d24bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.175691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c2354-4935-4161-a226-13df5d24bd54 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.176163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:51.177680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c2354-4935-4161-a226-13df5d24bd54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:51.177881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c2354-4935-4161-a226-13df5d24bd54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:51.179471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c2354-4935-4161-a226-13df5d24bd54 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:51.197196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 230/465] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:51.198650 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da08a-9e29-4fd4-bafa-7975823bcdbf None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.199114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da08a-9e29-4fd4-bafa-7975823bcdbf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.199536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1da08a-9e29-4fd4-bafa-7975823bcdbf None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.200941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 231/466] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:51.201772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1da08a-9e29-4fd4-bafa-7975823bcdbf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:51.215391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cf7f6-de20-4756-bfc3-1c54b200558e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:51.251174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:51.251728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.252006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.252304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.262845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:51.264354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:51.281262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:51.282195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:51.283029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:51.283029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:51.283029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:51.283029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 236/467] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:51.283235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:51.307972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1da08a-9e29-4fd4-bafa-7975823bcdbf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:51.346990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2582b40-1341-4b9f-a41f-fefb28284bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:51.347652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b40-1341-4b9f-a41f-fefb28284bbd None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.347935 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b40-1341-4b9f-a41f-fefb28284bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.348289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2582b40-1341-4b9f-a41f-fefb28284bbd None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.348947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582b40-1341-4b9f-a41f-fefb28284bbd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:51.350457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2582b40-1341-4b9f-a41f-fefb28284bbd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:51.375623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 232/468] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:51 2022] POST /identity/v3/users => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:51.376840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9e5a1-8dc5-4383-b0d3-1fd9b9643dd9 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.377127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9e5a1-8dc5-4383-b0d3-1fd9b9643dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.377399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9e5a1-8dc5-4383-b0d3-1fd9b9643dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.399254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-67e9e5a1-8dc5-4383-b0d3-1fd9b9643dd9 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:51.401110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-67e9e5a1-8dc5-4383-b0d3-1fd9b9643dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:51.403356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05900260-4a7e-4a86-9e1e-ae6d98a3a306 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:51.414062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:51.427289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:51.454207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f702-ab8f-442c-8f7e-f53a8a29f240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:51.455784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f702-ab8f-442c-8f7e-f53a8a29f240 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.456275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f702-ab8f-442c-8f7e-f53a8a29f240 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.456846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f702-ab8f-442c-8f7e-f53a8a29f240 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.457735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f702-ab8f-442c-8f7e-f53a8a29f240 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:51.459597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f702-ab8f-442c-8f7e-f53a8a29f240 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:51.496055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 237/469] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:51 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:51.496055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f702-ab8f-442c-8f7e-f53a8a29f240 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:51.513554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 233/470] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:51.636859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f702-ab8f-442c-8f7e-f53a8a29f240 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:51.678333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:51.678946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.679225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.679498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.680150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:51.680491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:51.681877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:51.695913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 238/471] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:51.701663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9e5a1-8dc5-4383-b0d3-1fd9b9643dd9 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:51.826740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9e5a1-8dc5-4383-b0d3-1fd9b9643dd9 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:51.866433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b901ee4-eff2-40a8-b5ab-0c1fd5721eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:51.867392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901ee4-eff2-40a8-b5ab-0c1fd5721eab None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.867882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901ee4-eff2-40a8-b5ab-0c1fd5721eab None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.868386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b901ee4-eff2-40a8-b5ab-0c1fd5721eab None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.869256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901ee4-eff2-40a8-b5ab-0c1fd5721eab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:51.870943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b901ee4-eff2-40a8-b5ab-0c1fd5721eab None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:51.876996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:51.895283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:51.902115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 234/472] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:51 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:51.918517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:51.988549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda92f-aacf-449c-b911-6b7c056d9187 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.989209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda92f-aacf-449c-b911-6b7c056d9187 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.989693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbda92f-aacf-449c-b911-6b7c056d9187 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:51.991243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 235/473] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:32:51.996456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cee7a-f593-4019-a8f7-6b082a5a1947 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:51.996716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e427e65-83bf-4616-a5ce-1df1f544a026 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:51.997197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cee7a-f593-4019-a8f7-6b082a5a1947 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:51.997660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3cee7a-f593-4019-a8f7-6b082a5a1947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:52.018641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8c3cee7a-f593-4019-a8f7-6b082a5a1947 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:52.020224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8c3cee7a-f593-4019-a8f7-6b082a5a1947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:52.067382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:52.068044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:52.069180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:52.069180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:52.091618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:52.093972 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:52.105828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 236/474] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:52.118140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:52.119474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:52.120345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:52.120345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:52.120345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:52.122414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 239/475] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:52.132410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cee7a-f593-4019-a8f7-6b082a5a1947 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:52.262404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3cee7a-f593-4019-a8f7-6b082a5a1947 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:52.294797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:52.302229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:52.302853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:52.303134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:52.303405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:52.304062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:52.304392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:52.305763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:52.323365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 237/476] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:52.329425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:52.432779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:52.485592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:52.516653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff085a0a-167c-4a5f-9400-8dc8ca6ffc93 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:52.560942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b079f9a7-3f50-44f2-a664-01bbc9efe704 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:52.601098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:52.602052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:52.602524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:52.603090 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:52.603960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:52.605528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:52.612940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0985-f2da-44a8-b50f-7c75b4441da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:52.614049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0985-f2da-44a8-b50f-7c75b4441da1 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:52.614517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0985-f2da-44a8-b50f-7c75b4441da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:52.614976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac0985-f2da-44a8-b50f-7c75b4441da1 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:52.615775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac0985-f2da-44a8-b50f-7c75b4441da1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:52.617702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac0985-f2da-44a8-b50f-7c75b4441da1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:52.621738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.sql.core [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 09:32:52.621738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 09:32:52.621738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [parameters: {'id': '35d5f6be30234e62b28824155a548774', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 09:32:52.621738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88101) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application conn.query(q) Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application result.read() Aug 31 09:32:52.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 09:32:52.642198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application next(self.gen) Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application yield resource Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application next(self.gen) Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise self.value Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application session.commit() Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 09:32:52.643080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.session.flush() Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application compat.raise_( Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 09:32:52.644628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 09:32:52.645836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application conn.query(q) Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application result.read() Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 09:32:52.647356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [parameters: {'id': '35d5f6be30234e62b28824155a548774', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:52.649438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 09:32:52.651506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:52.655878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 238/477] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 31 09:32:52 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:52.662018 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:52.671225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 240/478] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:52 2022] POST /identity/v3/users => generated 249 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:52.731067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:52.800252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98895424-9255-4ab8-92ae-be6926ccf725 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:52.851932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11c4ad-5abe-4bf3-ba5a-75f84805367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:52.852940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c4ad-5abe-4bf3-ba5a-75f84805367d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:52.853409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c4ad-5abe-4bf3-ba5a-75f84805367d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:52.853864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11c4ad-5abe-4bf3-ba5a-75f84805367d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:52.868696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11c4ad-5abe-4bf3-ba5a-75f84805367d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8a11c4ad-5abe-4bf3-ba5a-75f84805367d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:52.874796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:52.875739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 09:32:52.876559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:52.883560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 239/479] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:32:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:52.884622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0985-f2da-44a8-b50f-7c75b4441da1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:53.029324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac0985-f2da-44a8-b50f-7c75b4441da1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:53.068034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f971f4c-44a3-45b9-9018-4d64d1cdc36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:53.068697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971f4c-44a3-45b9-9018-4d64d1cdc36b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:53.068979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971f4c-44a3-45b9-9018-4d64d1cdc36b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:53.069251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f971f4c-44a3-45b9-9018-4d64d1cdc36b None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:53.069918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f971f4c-44a3-45b9-9018-4d64d1cdc36b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:53.070221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f971f4c-44a3-45b9-9018-4d64d1cdc36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:53.071603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f971f4c-44a3-45b9-9018-4d64d1cdc36b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:53.081528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 241/480] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:53.803063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01caa8-241a-422f-89c8-c7141c3e41da None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:53.804054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01caa8-241a-422f-89c8-c7141c3e41da None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:53.804540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d01caa8-241a-422f-89c8-c7141c3e41da None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:53.806343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 240/481] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:53.812211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9485c-ac4f-4370-92ca-136636d0b420 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:53.813105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9485c-ac4f-4370-92ca-136636d0b420 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:53.813596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9485c-ac4f-4370-92ca-136636d0b420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:53.824580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:53.838884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a9f9485c-ac4f-4370-92ca-136636d0b420 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:53.840437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a9f9485c-ac4f-4370-92ca-136636d0b420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:53.934440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 242/482] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:54.142255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74213-1d22-431e-8e04-c261fa0e9fde None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.142640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74213-1d22-431e-8e04-c261fa0e9fde None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.142815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d74213-1d22-431e-8e04-c261fa0e9fde None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.144399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 241/483] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:54.149630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ba9b-ca7b-4f8e-bab8-10dfdc61ebc4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.149923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ba9b-ca7b-4f8e-bab8-10dfdc61ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.150199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070ba9b-ca7b-4f8e-bab8-10dfdc61ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.173107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0070ba9b-ca7b-4f8e-bab8-10dfdc61ebc4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:54.174293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0070ba9b-ca7b-4f8e-bab8-10dfdc61ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:54.255390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 243/484] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:54.325296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55fdb-2f4f-42e8-811e-06e0e0b3421c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.325617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55fdb-2f4f-42e8-811e-06e0e0b3421c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.325848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e55fdb-2f4f-42e8-811e-06e0e0b3421c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.328080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 242/485] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:54.329110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070ba9b-ca7b-4f8e-bab8-10dfdc61ebc4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:54.332886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21da5a1-6537-429b-b69e-08555184c00f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.333166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21da5a1-6537-429b-b69e-08555184c00f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.333438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21da5a1-6537-429b-b69e-08555184c00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.361202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f21da5a1-6537-429b-b69e-08555184c00f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:54.362399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f21da5a1-6537-429b-b69e-08555184c00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:54.397557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:54.440948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070ba9b-ca7b-4f8e-bab8-10dfdc61ebc4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:54.480365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10416fa-e4e3-4f77-860f-ced3e19aade6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:54.481009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10416fa-e4e3-4f77-860f-ced3e19aade6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.481855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10416fa-e4e3-4f77-860f-ced3e19aade6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.482662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10416fa-e4e3-4f77-860f-ced3e19aade6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.494039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10416fa-e4e3-4f77-860f-ced3e19aade6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-f10416fa-e4e3-4f77-860f-ced3e19aade6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:54.500372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:54.501221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:32:54.502004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:54.502613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 244/486] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:32:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:54.508011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10416fa-e4e3-4f77-860f-ced3e19aade6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:54.536117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 243/487] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:54.575968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21da5a1-6537-429b-b69e-08555184c00f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:54.627707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:54.632957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10416fa-e4e3-4f77-860f-ced3e19aade6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:54.660290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:54.676162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:54.677170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.677679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.678140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.678988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:54.679488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:54.681095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:54.690972 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 245/488] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:32:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:54.699992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:54.706935 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21da5a1-6537-429b-b69e-08555184c00f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:54.747094 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36af4f-aff0-430f-b949-f4430dbd4b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:54.748449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36af4f-aff0-430f-b949-f4430dbd4b99 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.748735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36af4f-aff0-430f-b949-f4430dbd4b99 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.749008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36af4f-aff0-430f-b949-f4430dbd4b99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.760856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36af4f-aff0-430f-b949-f4430dbd4b99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ed36af4f-aff0-430f-b949-f4430dbd4b99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:54.766839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:54.768589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:54.769930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 244/489] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:32:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:32:54.777190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36af4f-aff0-430f-b949-f4430dbd4b99 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:54.911243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfc7d99-c097-411a-9ffe-0ab5423aa537 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:54.917403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36af4f-aff0-430f-b949-f4430dbd4b99 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:54.920636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:54.956952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:54.957564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.957776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:54.957894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.958103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.958418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:54.958703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:54.958819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:54.958989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:54.959082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:54.960540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:54.969553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 245/490] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:32:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:54.970383 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:54.974972 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:54.976672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:54.993394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:54.994312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:54.995154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:54.995154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:54.995154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:54.995154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 246/491] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:54.999323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.047950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:55.096345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf532ff-1644-4939-9284-796a01efff9c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.132579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7f7e9-5463-4d97-a4e2-357431af52cd None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.136332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fbeb2-c6a8-40bb-abd9-a15c9f3c2ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.137284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fbeb2-c6a8-40bb-abd9-a15c9f3c2ca2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.137765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fbeb2-c6a8-40bb-abd9-a15c9f3c2ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.138806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096fbeb2-c6a8-40bb-abd9-a15c9f3c2ca2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.150937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096fbeb2-c6a8-40bb-abd9-a15c9f3c2ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-096fbeb2-c6a8-40bb-abd9-a15c9f3c2ca2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:55.158133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:55.159027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:32:55.159818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:55.162575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 246/492] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:32:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:55.163731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fbeb2-c6a8-40bb-abd9-a15c9f3c2ca2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.170051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.170692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.170977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.171252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.185652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:55.187576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:55.199910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:55.206335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:55.207242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:55.208097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:55.208097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:55.208097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:55.215769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 247/493] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:55.218101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.291853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096fbeb2-c6a8-40bb-abd9-a15c9f3c2ca2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.322876 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:55.335382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.335999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.336314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.336590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.336959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d5f7e-cf9f-4d4c-a191-91751a053922 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.337250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:55.337554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:55.338947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:55.355201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 247/494] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:55.356913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.381881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.382902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.383522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.384001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.384896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:55.385456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:55.387240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:55.397665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 248/495] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:55.398903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.460399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:55.477637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f6a98-089a-416a-a689-4045d56e948a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.508872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02376e-95e4-43d4-8011-2737309ce257 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.514903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.515511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.515786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.516055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.516802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:55.517106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:55.518475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:55.534640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 248/496] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:55.534640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.547650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71214811-6a3d-4d5f-bf38-86a094e9ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.548057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71214811-6a3d-4d5f-bf38-86a094e9ef16 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.548371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71214811-6a3d-4d5f-bf38-86a094e9ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.548652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71214811-6a3d-4d5f-bf38-86a094e9ef16 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.557643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71214811-6a3d-4d5f-bf38-86a094e9ef16 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:55.559123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71214811-6a3d-4d5f-bf38-86a094e9ef16 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-71214811-6a3d-4d5f-bf38-86a094e9ef16 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:32:55.574159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:55.575114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:55.576120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 249/497] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:55.577232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc99e-cfb1-4cfe-8fe8-f2e0dfd09e82 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.577329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc99e-cfb1-4cfe-8fe8-f2e0dfd09e82 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.577574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc99e-cfb1-4cfe-8fe8-f2e0dfd09e82 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.578938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 250/498] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:55.582871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc99e-cfb1-4cfe-8fe8-f2e0dfd09e82 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.597475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:55.645496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4282aa68-56b1-4de9-aedb-d5becdf6426d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.680380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.681010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.681293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.681566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.692085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc99e-cfb1-4cfe-8fe8-f2e0dfd09e82 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.693190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:55.694675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:55.701086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:55.709449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:55.710337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:55.711213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:55.711213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:55.711213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:55.711213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 249/499] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:55.712131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.732490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabc458-3cba-4f14-b80b-b6dcd1a6b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.734245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc458-3cba-4f14-b80b-b6dcd1a6b83e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.735772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc458-3cba-4f14-b80b-b6dcd1a6b83e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.736090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabc458-3cba-4f14-b80b-b6dcd1a6b83e None admin] PATH_INFO: `/v3/users/nova` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.743411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabc458-3cba-4f14-b80b-b6dcd1a6b83e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:55.745044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabc458-3cba-4f14-b80b-b6dcd1a6b83e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ecabc458-3cba-4f14-b80b-b6dcd1a6b83e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:32:55.757635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:55.758607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:32:55.759497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:55.760331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 251/500] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:55.761663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3a666-1cbb-416c-b99b-1e3dfab7fd6b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.761954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3a666-1cbb-416c-b99b-1e3dfab7fd6b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.762231 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3a666-1cbb-416c-b99b-1e3dfab7fd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.780013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-07c3a666-1cbb-416c-b99b-1e3dfab7fd6b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:55.781272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-07c3a666-1cbb-416c-b99b-1e3dfab7fd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:55.812080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e713e3-ba88-4d5f-a322-eb60bdabc9c5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:55.846171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:55.846771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.847052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.847327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.848058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:55.848399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:55.848518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 252/501] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:55.849678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99e67-8ecc-40af-96fc-d22d1e4f5a79 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:55.849843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:55.849952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99e67-8ecc-40af-96fc-d22d1e4f5a79 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:55.850222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f99e67-8ecc-40af-96fc-d22d1e4f5a79 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:55.851605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 253/502] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:55.852907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99e67-8ecc-40af-96fc-d22d1e4f5a79 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.855729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:55.893696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 250/503] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:55.894648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:55.956429 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:55.969624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f99e67-8ecc-40af-96fc-d22d1e4f5a79 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.001932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e968f-4144-4d45-84c3-329424ae621a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.004141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87131971-cc16-468d-90cf-76537bebb999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.004803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131971-cc16-468d-90cf-76537bebb999 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.005087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131971-cc16-468d-90cf-76537bebb999 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.005372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131971-cc16-468d-90cf-76537bebb999 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.006003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87131971-cc16-468d-90cf-76537bebb999 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:56.006310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87131971-cc16-468d-90cf-76537bebb999 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.007724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87131971-cc16-468d-90cf-76537bebb999 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.024659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 254/504] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:56.024659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b40c7b-2f5c-40db-b7a3-6d6adfb56f92 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.024659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b40c7b-2f5c-40db-b7a3-6d6adfb56f92 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.024659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b40c7b-2f5c-40db-b7a3-6d6adfb56f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.037692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.038296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.038571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.038839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.039565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:56.039865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.040976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-28b40c7b-2f5c-40db-b7a3-6d6adfb56f92 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:56.041326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.042171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-28b40c7b-2f5c-40db-b7a3-6d6adfb56f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:56.059473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 251/505] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:32:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:56.060948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.109612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:56.132193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 255/506] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:32:56.132193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b40c7b-2f5c-40db-b7a3-6d6adfb56f92 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.182578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a801e-b9c9-45e3-b525-9db2b85ec815 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.197249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:56.223930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68197e-fa31-4d44-9e62-f868a2b658e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.224864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68197e-fa31-4d44-9e62-f868a2b658e8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.225348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68197e-fa31-4d44-9e62-f868a2b658e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.225861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed68197e-fa31-4d44-9e62-f868a2b658e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.238651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b40c7b-2f5c-40db-b7a3-6d6adfb56f92 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.272935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.273586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.273865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.274136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.281911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.283369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:32:56.297758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:56.298692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 256/507] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:56.299613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.314975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68197e-fa31-4d44-9e62-f868a2b658e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.317719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed68197e-fa31-4d44-9e62-f868a2b658e8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.356957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:56.409457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae57797-d145-428b-bff2-1da6d36596b7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.422109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 252/508] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:56.422966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68197e-fa31-4d44-9e62-f868a2b658e8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.439484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:56.447580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6278d-c737-4eeb-97b0-bc68751b1b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.448201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6278d-c737-4eeb-97b0-bc68751b1b18 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.448482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6278d-c737-4eeb-97b0-bc68751b1b18 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.448764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6278d-c737-4eeb-97b0-bc68751b1b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.516990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6278d-c737-4eeb-97b0-bc68751b1b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.518510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6278d-c737-4eeb-97b0-bc68751b1b18 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.523421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed68197e-fa31-4d44-9e62-f868a2b658e8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.556450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1457b-92e9-481b-aed9-3d0a24265d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.557063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1457b-92e9-481b-aed9-3d0a24265d99 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.557336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1457b-92e9-481b-aed9-3d0a24265d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.557610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1457b-92e9-481b-aed9-3d0a24265d99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.568233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1457b-92e9-481b-aed9-3d0a24265d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:32:56.570844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-a9b1457b-92e9-481b-aed9-3d0a24265d99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:32:56.573062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:56.574051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:56.574854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 253/509] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:56.575759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1457b-92e9-481b-aed9-3d0a24265d99 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.623676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 257/510] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:56.624563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6278d-c737-4eeb-97b0-bc68751b1b18 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.649470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:56.677215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1457b-92e9-481b-aed9-3d0a24265d99 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.711692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.712331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.712614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.712886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.713647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:56.713949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.715401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.724459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6278d-c737-4eeb-97b0-bc68751b1b18 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.733783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 254/511] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:56.734610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.760756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.761372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.761650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.761924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.772470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.773856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:56.788311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:56.789419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:56.790308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:56.790308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:56.790308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:56.790308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 258/512] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:56.790308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.793570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:56.835598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce81813-c81a-4914-abb0-b183519738bb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.866150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:56.871974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.872796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.873082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.873357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.883357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.884855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.892277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a3d83-a03b-42fe-af99-a70b0214aee5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:56.899332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:56.900281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:56.901111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:56.901111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:56.901111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:56.901111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 255/513] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:56.901337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:56.927398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:56.927994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:56.928304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:56.928577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:56.929228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:56.929526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:56.930894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:56.939250 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 259/514] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:56.940042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.004626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480be15-70a4-420a-9702-a1c81a08ccd6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.006683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.038911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.039737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.040019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.040340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.047226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d41ca-cbab-41c1-b98b-5cad4e63bbb1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.052528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.054109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:57.077199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:57.078147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:57.079005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:57.079005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:57.079005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:57.079005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 256/515] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:57.079225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.088812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477801-f674-44dc-b00c-953014c2d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.089422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477801-f674-44dc-b00c-953014c2d99f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.089750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477801-f674-44dc-b00c-953014c2d99f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.090023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477801-f674-44dc-b00c-953014c2d99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.119464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.170146 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4477801-f674-44dc-b00c-953014c2d99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.171763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4477801-f674-44dc-b00c-953014c2d99f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.194017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5ce0a-5d60-4d2d-a012-e040d791493f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.230041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.230642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.230920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.231222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.231871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:57.232192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.233562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.240956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.248339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 257/516] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:57.249300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.284873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 260/517] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:57.286041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477801-f674-44dc-b00c-953014c2d99f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.359813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.367582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e73345-68eb-4b65-bc35-c941c6e12c1c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.390566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477801-f674-44dc-b00c-953014c2d99f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.403142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.403750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.404032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.404353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.405000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:57.405305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.406699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.418100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 258/518] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:57.419449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.424539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.425168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.425449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.425726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.436640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.438102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:57.452992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:57.453918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:57.454777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:57.454777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:57.454777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:57.454777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 261/519] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:57.455003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.473348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.520247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62c0d7-7682-4eb4-ba57-888af1b59dd4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.553274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e870cd2-72df-4ea2-bc7b-6149004160e8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.553754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.554356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.554643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.554912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.555547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:57.555847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.557256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.574463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 259/520] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:57.574463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.585972 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7710de-57c2-43ed-a793-0f5eb8fca1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.586600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7710de-57c2-43ed-a793-0f5eb8fca1ee None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.586878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7710de-57c2-43ed-a793-0f5eb8fca1ee None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.587152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7710de-57c2-43ed-a793-0f5eb8fca1ee None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.587785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7710de-57c2-43ed-a793-0f5eb8fca1ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.589253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7710de-57c2-43ed-a793-0f5eb8fca1ee None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.591086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.612882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 262/521] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:32:57 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:32:57.613700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7710de-57c2-43ed-a793-0f5eb8fca1ee None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.683461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d5db2-ea14-42d3-b5ae-ba3ede152ad9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.712931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.729704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.730343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.730623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.730927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.742213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.743707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.743935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7710de-57c2-43ed-a793-0f5eb8fca1ee None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:57.760204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:57.761330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:57.762249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:57.762249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:57.762249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:57.764658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 260/522] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:57.765602 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.789621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.790406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.790584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.790839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.799433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.800949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:32:57.814775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:57.815655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:57.816830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 263/523] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:57.817441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.845147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.883162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660cee5-7570-4e94-bb30-52ba5725b6a6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.920026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.920792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.921068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.921340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.921989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:57.922278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.923643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.930219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee1134-27ef-4b0b-84b8-b26c39346f78 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:57.936383 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 261/524] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:57.937196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:57.970692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:57.971319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:57.971596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:57.971869 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:57.974225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:57.980163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:57.982698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:32:57.994544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:57.995581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:57.997233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:32:57.997233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:32:57.997233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:32:57.997233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:32:57.997233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:32:57.997233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:32:57.997233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:32:57.997233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:32:57.998138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 264/525] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:57.998824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.048820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccf43d-40fe-4dfc-adea-4ccb41805ca5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.078413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:58.087469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.088080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.088388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.088660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.089315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:58.089632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.091773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.103743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 262/526] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:58.105030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.111152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc06e7-732b-43f2-8d4d-e404a05f7864 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.148744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.149419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.149702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.149977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.150915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:58.151087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.152742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.177160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 265/527] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:32:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:58.177160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.212921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f68890-3640-495b-96d3-0b8f161d9a7c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.233431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:58.248456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.249084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.249364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.249634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.257086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.258542 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:32:58.272841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:58.273845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 263/528] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:58.274734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.288222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb1f2e-5051-473e-8341-a0e32fb9353c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.325044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.325654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.325919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.326193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.326882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:58.327185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.328497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:58.328690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.341429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 266/529] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:58.342339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.387604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8161388-0e3d-4368-ae71-7a35bb5eaed7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.423663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.424233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.424515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.424784 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.431949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.433557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:32:58.446617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:58.447646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:58.448853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 264/530] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:58.453318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.454571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780619b-e6ba-45da-aaa8-cb7e84d55aa2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.468845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:58.490662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.491265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.491547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.491826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.492577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=65c0bf4de3a1442c8b856efbfac436fa) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:58.492893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.494346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.500508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 267/531] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/role_assignments?user.id=65c0bf4de3a1442c8b856efbfac436fa&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:58.501312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.600793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47595-d78a-4fa6-9e4b-721ad170b20b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.614862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:58.640905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d9a4b-16f8-463a-89a0-c9d1ad1987c7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.653925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.653925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.654325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.654495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.656643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:58.656643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.658267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.682392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.683337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.684574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.685046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.685963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=0365be92a5d54c8ea32fd003a5619a70) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:58.686460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.687822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 265/532] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:58.688576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.688836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.696422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 268/533] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/role_assignments?user.id=0365be92a5d54c8ea32fd003a5619a70&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:58.697659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:58.800161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:58.889488 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f5b0c-677b-427e-9e61-9fa14b4425ef None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.900553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c11251-6c2b-4121-b1a5-a7648e9595ec None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:58.942834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.943370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.943649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.943920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.945174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:58.946811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:58.948830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43769e-0109-42af-9d68-9a41fae0b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:58.950085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43769e-0109-42af-9d68-9a41fae0b4ad None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:58.950365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43769e-0109-42af-9d68-9a41fae0b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:58.950640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43769e-0109-42af-9d68-9a41fae0b4ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:58.951278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:58.985352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 266/534] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:58.991531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:59.040562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:59.137289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43769e-0109-42af-9d68-9a41fae0b4ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:59.139542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43769e-0109-42af-9d68-9a41fae0b4ad None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:59.140645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fcbc4-7146-48bb-91ae-7599191739a2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:59.182432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:59.183187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:59.183520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:59.183790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:59.184560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=1aca2564475e4df98d4aef031d0b4302) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:59.184870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:59.186516 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:59.193319 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 267/535] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/role_assignments?user.id=1aca2564475e4df98d4aef031d0b4302&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:59.248681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:59.341530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 269/536] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:32:59.346959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:59.456713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:59.466282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f2190-e056-4cd9-8ddc-7bd94e645886 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:59.509428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:59.510065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:59.510346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:59.510619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:59.525793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:59.527460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:32:59.546797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:59.547774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:32:59.548651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:32:59.548651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:32:59.548651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:59.552365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 268/537] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:32:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:59.553930 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43769e-0109-42af-9d68-9a41fae0b4ad None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:59.659079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43769e-0109-42af-9d68-9a41fae0b4ad None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:59.698271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b9a52-6113-4e23-9d34-67121e9e18ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:59.699425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9a52-6113-4e23-9d34-67121e9e18ea None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:59.699710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9a52-6113-4e23-9d34-67121e9e18ea None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:59.699979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b9a52-6113-4e23-9d34-67121e9e18ea None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:59.700654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b9a52-6113-4e23-9d34-67121e9e18ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:32:59.700956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b9a52-6113-4e23-9d34-67121e9e18ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:59.702367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b9a52-6113-4e23-9d34-67121e9e18ea None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:59.720081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 270/538] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:32:59.725473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:32:59.786721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8277dd8-2ddf-46ad-8514-120263c2e1fe None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:59.787075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8277dd8-2ddf-46ad-8514-120263c2e1fe None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:59.787360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8277dd8-2ddf-46ad-8514-120263c2e1fe None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:59.788932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 271/539] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:32:59.794272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6fe9-f2e3-4c21-9eb8-b39e8d47972c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:59.794560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6fe9-f2e3-4c21-9eb8-b39e8d47972c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:59.794839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6fe9-f2e3-4c21-9eb8-b39e8d47972c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:59.801508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:32:59.814576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b5ce6fe9-f2e3-4c21-9eb8-b39e8d47972c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:32:59.817991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b5ce6fe9-f2e3-4c21-9eb8-b39e8d47972c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:32:59.879393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a60b17e-921d-4499-b462-07febae7d11f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:32:59.900286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 272/540] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:32:59.927814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:32:59.928482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:32:59.928765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:32:59.929101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:32:59.943500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:32:59.945067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:32:59.965354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:32:59.966230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:32:59.967125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 269/541] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:32:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:32:59.972566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6fe9-f2e3-4c21-9eb8-b39e8d47972c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:00.134478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6fe9-f2e3-4c21-9eb8-b39e8d47972c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:00.173024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:00.178574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:00.179178 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:00.179454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:00.179727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:00.180439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:00.180738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:00.182167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:00.203537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 273/542] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:32:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:00.209174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:00.212064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:00.266038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:00.347245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424094d-fc0d-4eb1-bce4-3e842468d514 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:00.382077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:00.382683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:00.382966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:00.383239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:00.383975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=886e718c9d7d48aa8655b8993e2af945) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:00.384310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:00.385793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:00.392221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 270/543] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:00 2022] GET /identity/v3/role_assignments?user.id=886e718c9d7d48aa8655b8993e2af945&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:00.469649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f754ae-c1ec-436b-a01e-841530805112 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:00.532610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636a1b3-8a8e-4954-9d8e-c137ff930352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:00.533177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a1b3-8a8e-4954-9d8e-c137ff930352 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:00.533457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a1b3-8a8e-4954-9d8e-c137ff930352 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:00.533725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636a1b3-8a8e-4954-9d8e-c137ff930352 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:00.549512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636a1b3-8a8e-4954-9d8e-c137ff930352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4636a1b3-8a8e-4954-9d8e-c137ff930352 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:00.554791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:00.556878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:00.559433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 274/544] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:00.564196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:00.675659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:00.696014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261abbb-aca4-4367-a7cc-e3ed4ef58191 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:00.696014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261abbb-aca4-4367-a7cc-e3ed4ef58191 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:00.696014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261abbb-aca4-4367-a7cc-e3ed4ef58191 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:00.696888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 275/545] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:00.703221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a8d3-ea3d-40e1-b6a0-885014f87e40 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:00.703772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a8d3-ea3d-40e1-b6a0-885014f87e40 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:00.704319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a8d3-ea3d-40e1-b6a0-885014f87e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:00.735355 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f502a8d3-ea3d-40e1-b6a0-885014f87e40 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:00.736593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f502a8d3-ea3d-40e1-b6a0-885014f87e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:00.740690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2c5a09-0f5a-4155-87aa-dbcee3204f39 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:00.809186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:00.809718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:00.810000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:00.810262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:00.810934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:00.811230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:00.812626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:00.832893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 271/546] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:00.834147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:00.839433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:00.876071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 276/547] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:33:00.983385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919fa6c-19f6-4224-a9c4-acba12157322 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:01.007585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2b58-0992-47ed-8cc6-5f3c10504356 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.007874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2b58-0992-47ed-8cc6-5f3c10504356 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.008153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da2b58-0992-47ed-8cc6-5f3c10504356 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.010911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 277/548] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:01.011534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:01.018405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbf7e-b47e-43f7-9ef2-a1e7c3280783 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.018689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbf7e-b47e-43f7-9ef2-a1e7c3280783 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.018965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdbf7e-b47e-43f7-9ef2-a1e7c3280783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.019575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:01.020228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.020514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.020785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.040035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:01.043250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:01.057505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-69cdbf7e-b47e-43f7-9ef2-a1e7c3280783 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:01.059829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-69cdbf7e-b47e-43f7-9ef2-a1e7c3280783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:01.075127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:01.076132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:01.077006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:01.077006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:01.077006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:01.078332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 272/549] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:01.083259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.186324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 278/550] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:01.187193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdbf7e-b47e-43f7-9ef2-a1e7c3280783 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.264910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8615f4fb-f8da-4c45-b2c7-4e01152d48d6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:01.328501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:01.329033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.329310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.329576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.330220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:01.330518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:01.331871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:01.358675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 273/551] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:01.364588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.382760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdbf7e-b47e-43f7-9ef2-a1e7c3280783 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:01.406436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:01.442670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:01.450356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c8eb9-df7e-4eda-a33f-98e81f975d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:01.451050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8eb9-df7e-4eda-a33f-98e81f975d85 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.451559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8eb9-df7e-4eda-a33f-98e81f975d85 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.451717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8eb9-df7e-4eda-a33f-98e81f975d85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.473441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c8eb9-df7e-4eda-a33f-98e81f975d85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-cb3c8eb9-df7e-4eda-a33f-98e81f975d85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:01.479483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:01.481141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:01.481943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 279/552] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:01.482640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c8eb9-df7e-4eda-a33f-98e81f975d85 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.540550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dcfb7d-28f3-4b7d-bdc9-04749da6c3d3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:01.587330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:01.587880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.588156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.588467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] PATH_INFO: `/v3/users/swift` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.599380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:01.601685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:01.603128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c8eb9-df7e-4eda-a33f-98e81f975d85 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:01.617585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:01.618562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:01.619658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 274/553] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:01.628197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.643260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159c6e6-2300-4d7d-b8ed-ab95b4113721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:01.643892 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159c6e6-2300-4d7d-b8ed-ab95b4113721 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.644190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159c6e6-2300-4d7d-b8ed-ab95b4113721 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.644480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159c6e6-2300-4d7d-b8ed-ab95b4113721 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.658006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159c6e6-2300-4d7d-b8ed-ab95b4113721 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-b159c6e6-2300-4d7d-b8ed-ab95b4113721 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:01.665444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:01.668649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 280/554] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:01.670752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159c6e6-2300-4d7d-b8ed-ab95b4113721 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.708437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:01.752564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:01.755974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16861-ff03-4b0a-b561-a86265a9842e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:01.790743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159c6e6-2300-4d7d-b8ed-ab95b4113721 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:01.800296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:01.800931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.801571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.801850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.802823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:01.803136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:01.804534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:01.813347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 275/555] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:01.813990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.832756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520faf16-9bbc-4201-9469-7c270b71f16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:01.833364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520faf16-9bbc-4201-9469-7c270b71f16e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.833643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520faf16-9bbc-4201-9469-7c270b71f16e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.833901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520faf16-9bbc-4201-9469-7c270b71f16e None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.834628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520faf16-9bbc-4201-9469-7c270b71f16e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:01.834929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520faf16-9bbc-4201-9469-7c270b71f16e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:01.836404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520faf16-9bbc-4201-9469-7c270b71f16e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:01.873315 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 281/556] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:01.874553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12fd1-a800-440e-a606-9d82a364edbe None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.874842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12fd1-a800-440e-a606-9d82a364edbe None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.875119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca12fd1-a800-440e-a606-9d82a364edbe None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.880226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 282/557] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:01.880226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca12fd1-a800-440e-a606-9d82a364edbe None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.932072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ffb925-baf2-44a9-b97a-5d6152831bc9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:01.971838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:01.972469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:01.972750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:01.973022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:01.973689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:01.973982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:01.975337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:01.983981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 276/558] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:01.984337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:01.984815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:01.999834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca12fd1-a800-440e-a606-9d82a364edbe None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.012045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:02.035488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea175966-accc-49f6-a6ff-0136571ea5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.036120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea175966-accc-49f6-a6ff-0136571ea5fa None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.036434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea175966-accc-49f6-a6ff-0136571ea5fa None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.036716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea175966-accc-49f6-a6ff-0136571ea5fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.047413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea175966-accc-49f6-a6ff-0136571ea5fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:02.048931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea175966-accc-49f6-a6ff-0136571ea5fa None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ea175966-accc-49f6-a6ff-0136571ea5fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:02.065760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:02.066711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:02.068240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:02.068240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:02.068240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:02.068240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 283/559] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:02.068462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c258c3-8f0e-4de3-9e7e-fe528d9576ad None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.068700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c258c3-8f0e-4de3-9e7e-fe528d9576ad None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.068974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c258c3-8f0e-4de3-9e7e-fe528d9576ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.087523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c6c258c3-8f0e-4de3-9e7e-fe528d9576ad None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:02.089432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c6c258c3-8f0e-4de3-9e7e-fe528d9576ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:02.099471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c7aae6-1247-4b91-a716-571ed7fdd9cc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.140225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb53dac-275a-42be-b32e-15aacddc4565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.140853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53dac-275a-42be-b32e-15aacddc4565 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.141222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53dac-275a-42be-b32e-15aacddc4565 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.141570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53dac-275a-42be-b32e-15aacddc4565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.161335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 284/560] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:02.162124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c258c3-8f0e-4de3-9e7e-fe528d9576ad None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:02.235034 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb53dac-275a-42be-b32e-15aacddc4565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:02.236679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb53dac-275a-42be-b32e-15aacddc4565 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:02.259739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:02.266780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:02.302232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c258c3-8f0e-4de3-9e7e-fe528d9576ad None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.357250 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.358370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.358727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.359075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.373670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:02.375336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:02.375554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 277/561] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:02.376875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb53dac-275a-42be-b32e-15aacddc4565 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:02.395948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:02.397148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:02.398262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:02.398262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:02.398262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:02.400244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 285/562] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:02.402151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:02.507403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb53dac-275a-42be-b32e-15aacddc4565 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.518151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035eb372-7a82-4c37-8359-1ea52a37e541 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.535600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:02.543688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:02.546988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.547591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.547863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.548132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.548811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:02.549109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:02.550477 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:02.554961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.555582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.555861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.556135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.561711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 278/563] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:02.562434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:02.569857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:02.571413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:02.586661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:02.587737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:02.589726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:02.589726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:02.589726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:02.592550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 286/564] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:02.593533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:02.662887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e8f20-838c-4638-9077-ffb31702ee7f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.693072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4126a-85e1-48f6-98eb-318c2e84f12b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.695110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4f6df-1887-4b27-a500-c9d748137d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.695710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4f6df-1887-4b27-a500-c9d748137d37 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.695983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4f6df-1887-4b27-a500-c9d748137d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.696277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4f6df-1887-4b27-a500-c9d748137d37 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.696914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4f6df-1887-4b27-a500-c9d748137d37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:02.697210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4f6df-1887-4b27-a500-c9d748137d37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:02.699281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4f6df-1887-4b27-a500-c9d748137d37 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:02.710623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 279/565] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:02.711857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4f57-3214-4117-80bc-d3240336b49b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.712143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4f57-3214-4117-80bc-d3240336b49b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.712439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063f4f57-3214-4117-80bc-d3240336b49b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.714309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 280/566] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:02.715001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4f57-3214-4117-80bc-d3240336b49b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:02.732320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3e802-4792-47c1-9e45-369dc79c7f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.732957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e802-4792-47c1-9e45-369dc79c7f77 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.733237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e802-4792-47c1-9e45-369dc79c7f77 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.733515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3e802-4792-47c1-9e45-369dc79c7f77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.743856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3e802-4792-47c1-9e45-369dc79c7f77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-66d3e802-4792-47c1-9e45-369dc79c7f77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:02.749375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:02.750474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 287/567] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:02.751513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3e802-4792-47c1-9e45-369dc79c7f77 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:02.764163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:02.790859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:02.818834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063f4f57-3214-4117-80bc-d3240336b49b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.852142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.852792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.853066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.853335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.855785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3e802-4792-47c1-9e45-369dc79c7f77 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.860877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:02.862305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:02.873909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:02.874864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 281/568] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:02.875777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:02.890941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee660e9-b21a-4d7e-a24a-a8be095f051c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:02.891547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee660e9-b21a-4d7e-a24a-a8be095f051c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.891821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee660e9-b21a-4d7e-a24a-a8be095f051c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.892089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee660e9-b21a-4d7e-a24a-a8be095f051c None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.892751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee660e9-b21a-4d7e-a24a-a8be095f051c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:02.893049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee660e9-b21a-4d7e-a24a-a8be095f051c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:02.894460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee660e9-b21a-4d7e-a24a-a8be095f051c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:02.905836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 288/569] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:02.907043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e12b-d33e-4116-ae33-0e71e9188449 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:02.907330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e12b-d33e-4116-ae33-0e71e9188449 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:02.907607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5e12b-d33e-4116-ae33-0e71e9188449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:02.926139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-04f5e12b-d33e-4116-ae33-0e71e9188449 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:02.927257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-04f5e12b-d33e-4116-ae33-0e71e9188449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:02.975011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26774a61-5d5c-45de-957c-7cd52bce87e2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:02.977299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:02.995472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 289/570] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:02.996342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e12b-d33e-4116-ae33-0e71e9188449 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.016764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.017396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.017675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.017945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.025538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.026986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.029342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:03.038522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:03.039479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:03.040461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:03.044249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 282/571] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:03.045086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.110353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5e12b-d33e-4116-ae33-0e71e9188449 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.146183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.146807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.147164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.147378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.147992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:03.148320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.149703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.156783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24485183-d7e0-4298-91e8-0751337ae617 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.158478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 290/572] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:03.159289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.196321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.196853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.197135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.198072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.198725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:03.199034 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.200489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.218130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 283/573] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:03.218780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.245616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.262183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.274997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e076-5144-49bf-863a-07d1a5a9c900 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.307975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.308618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.308898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.309173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.315830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.317364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.326309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a69580-1d70-4464-b78b-f8c60dfee8f7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:03.329171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:03.330219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:03.331365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:03.331365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:03.331365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:03.331365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:03.331365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:03.331365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:03.331365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:03.331365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:03.335105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 291/574] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:03.335784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.361519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.362122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.362407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.362679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.363411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:03.363715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.365166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.382080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 284/575] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:03.382878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.439815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd75e3-b36a-4a30-b1fa-c1932d4c61cb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.463567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.474083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.474709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.474991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.475275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.482840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72db11-5128-4a17-819f-dd28acc863b6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.485634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.487103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.494964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:03.502068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:03.503038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:03.509258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:03.509258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:03.509258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:03.509258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 292/576] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:03.509258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.516746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.517366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.517640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.518013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.528559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.529988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:03.544664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:03.545587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:03.546453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:03.546453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:03.546453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:03.546453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 285/577] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:03.546681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.607662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e504d8-15d3-489b-b720-7ddd27ae4b08 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.639878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1f501-ed21-4ea3-a70e-73989fdb1769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.640545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1f501-ed21-4ea3-a70e-73989fdb1769 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.640821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1f501-ed21-4ea3-a70e-73989fdb1769 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.641089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b1f501-ed21-4ea3-a70e-73989fdb1769 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.647158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5883d5b-920c-4eff-aeef-b0a675a6b9bf None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.651397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b1f501-ed21-4ea3-a70e-73989fdb1769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-27b1f501-ed21-4ea3-a70e-73989fdb1769 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:03.656784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:03.657748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 293/578] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:03.658616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1f501-ed21-4ea3-a70e-73989fdb1769 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.681265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.686867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.687473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.687750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.688023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.689013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:03.689310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.690717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.703025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 286/579] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:03.703894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.723166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.764890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b1f501-ed21-4ea3-a70e-73989fdb1769 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.797898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.798523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.798803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.799080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.803786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75297b2-d2d1-4a5e-a0e5-283c1ed1c359 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.809844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.811333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:03.826523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:03.827667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:03.828790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:03.828790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:03.828790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:03.828790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 294/580] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:03.828790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.840524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.841133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.841411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.841678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.842313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:03.842608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.843959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.855417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 287/581] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:03.856267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.909433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.937760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9cea1-29b0-45d8-96cc-063e4940771f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.951771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:03.958865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8645bb-8954-477d-9f9e-48714488bd0b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:03.973126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.973782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.974009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.974279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.974921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:03.975221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.976641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:03.988803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 295/582] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:03.989587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:03.992690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:03.993517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:03.993645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:03.993842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:03.995264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:03.995590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:03.996991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.005147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 288/583] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:04.005939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.093289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b3f0cd-8530-4da7-bc88-81bd112e2db5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.104346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ec28-c45c-42fd-ae88-6597223ca356 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.117722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:04.126454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.127076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.127404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.127711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.128512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=cda7a66a7e054a968f8f633762a1c79b) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:04.128838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.130419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.136302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 296/584] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:03 2022] GET /identity/v3/role_assignments?user.id=cda7a66a7e054a968f8f633762a1c79b&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:04.137136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.139009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.139632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.139912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.140209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.140884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:04.141190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.142595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.161472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 289/585] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:04.161472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.181858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:04.260963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc661f-4e96-4fef-a805-820abf8cc0df None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.273458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb34cde-8154-459b-84ea-bc97f51654bd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.298637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.299259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.299539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.299810 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.308596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.310322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.311669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.312352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.312670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.313063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.320137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.321641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:04.323474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:04.324581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 297/586] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:04.325488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:04.339518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:04.340943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:04.342072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:04.342072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:04.342072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:04.342072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:04.342072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:04.342072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:04.342072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:04.342072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:04.345427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 290/587] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:04.346266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.384437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:04.432206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:04.440364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec97c08-5dff-4298-9499-4f1a57a590d2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.455079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bbacb-4dee-4c1f-88df-88f83e667cf6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.480202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.480809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.481087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.481374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.491081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.491712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.491993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.492228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.492332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.493689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.499138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.500589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:04.508160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:04.509079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:04.510115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:04.510115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:04.510115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:04.511986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:04.512832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:04.513678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 291/588] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:04.514146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.514964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 298/589] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:04.516057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.616447 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:04.622893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128f783f-094d-4d4d-91cc-c5c6e020c66e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.625127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369181ce-2f6b-4311-a8a8-6ece080aecbd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.658336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.659106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.659384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.659559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.659672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.660132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.660346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:04.660461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.660649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.660747 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.661429 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:04.661736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.662076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.663184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.684519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 299/590] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:04.685377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.696548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 292/591] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:04.696548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.700058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:04.796393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfbccc-ed85-4071-8a5d-41c2b275749c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.796925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60421076-2fdb-4d1a-9a8f-be0ae7b09082 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.831374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.831650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.831972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.832276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.832546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.832639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.833009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.833188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:04.833461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.833559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.834310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:04.834713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:04.834824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.836353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:04.850240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 293/592] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:04.851035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.854090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 300/593] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:04.854700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:04.872888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:04.926883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:04.960356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642580c-5d09-491e-84e6-3927680254fc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.964207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b26e19-5f73-4c94-84bc-4fc977635944 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:04.996085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55138068-3337-4907-99f3-008ed0c46e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:04.997170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138068-3337-4907-99f3-008ed0c46e55 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:04.997681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138068-3337-4907-99f3-008ed0c46e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:04.998123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55138068-3337-4907-99f3-008ed0c46e55 None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/65c0bf4de3a1442c8b856efbfac436fa/roles/debd25f091134ad1a9b107790a189b51` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:04.999497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.000117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.000440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.000714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.012080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.013587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.013805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55138068-3337-4907-99f3-008ed0c46e55 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=65c0bf4de3a1442c8b856efbfac436fa, role_id=debd25f091134ad1a9b107790a189b51)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.015542 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55138068-3337-4907-99f3-008ed0c46e55 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:05.028141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:05.029349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:05.030271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:05.030271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:05.030271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:05.030271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 301/594] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:05.030271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.031421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 294/595] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:04 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/65c0bf4de3a1442c8b856efbfac436fa/roles/debd25f091134ad1a9b107790a189b51 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:33:05.032428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55138068-3337-4907-99f3-008ed0c46e55 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.112606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:05.156984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55138068-3337-4907-99f3-008ed0c46e55 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:05.196236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d03617-3b7e-4a46-93c9-0f66bcd5001e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:05.203594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.204279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.204560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.204833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.213551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.216204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.221068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:05.228846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:05.230010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:05.230930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 295/596] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:05.231530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.248325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309adcb-9856-4471-8c66-39304c9df706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.249081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309adcb-9856-4471-8c66-39304c9df706 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.249381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309adcb-9856-4471-8c66-39304c9df706 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.249776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309adcb-9856-4471-8c66-39304c9df706 None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/0365be92a5d54c8ea32fd003a5619a70/roles/debd25f091134ad1a9b107790a189b51` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.269027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309adcb-9856-4471-8c66-39304c9df706 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=0365be92a5d54c8ea32fd003a5619a70, role_id=debd25f091134ad1a9b107790a189b51)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.270776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7309adcb-9856-4471-8c66-39304c9df706 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.288464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 302/597] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:05 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/0365be92a5d54c8ea32fd003a5619a70/roles/debd25f091134ad1a9b107790a189b51 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:33:05.289307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309adcb-9856-4471-8c66-39304c9df706 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.372623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a007f9-4708-457a-bdf8-5eed8d21e816 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:05.416578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:05.442040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.442669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.442952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.443223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.443888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:05.444207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.445604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.472212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 296/598] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:05.476606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.504919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309adcb-9856-4471-8c66-39304c9df706 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:05.557671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.558368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.558723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.559000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.559850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:05.560323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.561722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.582039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 303/599] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 31 09:33:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:05.587681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.622190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07a419-54d8-4ec7-9021-9c99af13eb60 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:05.635181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:05.664380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.666310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.666797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.667263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.675658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.677570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:05.691810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:05.692749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:05.693630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:05.693630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:05.693630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:05.693630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:05.693630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:05.693630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:05.693630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:05.693630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:05.696242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 297/600] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:05.702453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.755601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165093d-5c46-4534-820c-9c31358bdd2c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:05.768668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:05.793700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.794547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.794890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.795386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.806743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.808371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:05.825051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:05.826227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:05.827303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:05.827303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:05.827303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:05.828213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 304/601] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:05.833287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.881135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b15de-702f-4387-9280-b7aab72ee2b1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:05.918055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:05.938598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1a3ae-eab6-47f7-8f48-0147fa1e2996 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:05.952940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.953642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.953926 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.954210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.954955 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:05.955263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.956732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.975528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:05.976186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:05.976577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:05.976856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:05.977501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:05.977863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:05.979363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:05.987600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 298/602] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:05.991856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 305/603] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:05.994061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:05.997935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:06.191396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5fed94-4d32-4932-9bb8-37442393bd97 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:06.194079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:06.204538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cfaada-94c0-4a47-89e7-b81972684928 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:06.249891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeff337-2d22-4f46-b0da-98eea62494d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:06.250554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff337-2d22-4f46-b0da-98eea62494d2 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:06.250832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff337-2d22-4f46-b0da-98eea62494d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:06.251102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeff337-2d22-4f46-b0da-98eea62494d2 None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/1aca2564475e4df98d4aef031d0b4302/roles/debd25f091134ad1a9b107790a189b51` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:06.253606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b95fdc-5f72-43b7-b7c8-fc64c86f8abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:06.254230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95fdc-5f72-43b7-b7c8-fc64c86f8abf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:06.254504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95fdc-5f72-43b7-b7c8-fc64c86f8abf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:06.254769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b95fdc-5f72-43b7-b7c8-fc64c86f8abf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:06.264859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b95fdc-5f72-43b7-b7c8-fc64c86f8abf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:06.266626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b95fdc-5f72-43b7-b7c8-fc64c86f8abf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:06.270322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:06.273398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeff337-2d22-4f46-b0da-98eea62494d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=1aca2564475e4df98d4aef031d0b4302, role_id=debd25f091134ad1a9b107790a189b51)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:06.276330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeff337-2d22-4f46-b0da-98eea62494d2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-b6b95fdc-5f72-43b7-b7c8-fc64c86f8abf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:06.284245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:06.285210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:06.286072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 306/604] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:06.287515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd259-73e3-486e-acdb-016ca077cd29 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:06.287892 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd259-73e3-486e-acdb-016ca077cd29 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:06.288286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bd259-73e3-486e-acdb-016ca077cd29 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:06.290126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 307/605] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:06.291065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bd259-73e3-486e-acdb-016ca077cd29 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:06.296682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 299/606] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:05 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/1aca2564475e4df98d4aef031d0b4302/roles/debd25f091134ad1a9b107790a189b51 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:33:06.305323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884562f4-be04-46d7-8310-907734b84627 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:06.305876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884562f4-be04-46d7-8310-907734b84627 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:06.306292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884562f4-be04-46d7-8310-907734b84627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:06.337874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-884562f4-be04-46d7-8310-907734b84627 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:06.339492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-884562f4-be04-46d7-8310-907734b84627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:06.403801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bd259-73e3-486e-acdb-016ca077cd29 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:06.442264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:06.442973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:06.443348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:06.443713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:06.444601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:06.445002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:06.447160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:06.460334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 308/607] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:06.469354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:06.490816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 300/608] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:06.596825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:06.609723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db39af7-3896-4b28-8ee9-8dfdcfe3340c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:06.645596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1977-6450-4c03-9cd3-5efb38fadbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:06.646246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1977-6450-4c03-9cd3-5efb38fadbed None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:06.646524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1977-6450-4c03-9cd3-5efb38fadbed None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:06.646850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448f1977-6450-4c03-9cd3-5efb38fadbed None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/886e718c9d7d48aa8655b8993e2af945/roles/debd25f091134ad1a9b107790a189b51` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:06.662939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f1977-6450-4c03-9cd3-5efb38fadbed None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=886e718c9d7d48aa8655b8993e2af945, role_id=debd25f091134ad1a9b107790a189b51)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:06.664438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448f1977-6450-4c03-9cd3-5efb38fadbed None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:06.682513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 309/609] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:06 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/886e718c9d7d48aa8655b8993e2af945/roles/debd25f091134ad1a9b107790a189b51 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:33:06.791709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884562f4-be04-46d7-8310-907734b84627 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:06.883996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:06.906538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884562f4-be04-46d7-8310-907734b84627 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:06.945583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00fa3-4bc4-4045-a366-6375e7dca85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:06.946853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00fa3-4bc4-4045-a366-6375e7dca85d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:06.947143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00fa3-4bc4-4045-a366-6375e7dca85d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:06.947390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe00fa3-4bc4-4045-a366-6375e7dca85d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:06.958190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe00fa3-4bc4-4045-a366-6375e7dca85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9fe00fa3-4bc4-4045-a366-6375e7dca85d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:06.963570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:06.965826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:06.967804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 301/610] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:06.978181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1977-6450-4c03-9cd3-5efb38fadbed None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:07.088690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448f1977-6450-4c03-9cd3-5efb38fadbed None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:07.100556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:07.129936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d64552-c68d-4355-bb2f-508c373ad1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:07.130668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d64552-c68d-4355-bb2f-508c373ad1ae None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:07.130954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d64552-c68d-4355-bb2f-508c373ad1ae None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:07.131230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d64552-c68d-4355-bb2f-508c373ad1ae None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:07.131901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d64552-c68d-4355-bb2f-508c373ad1ae None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:07.132221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d64552-c68d-4355-bb2f-508c373ad1ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:07.133622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d64552-c68d-4355-bb2f-508c373ad1ae None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:07.145671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 310/611] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:07.151339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00fa3-4bc4-4045-a366-6375e7dca85d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:07.221685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822000e1-2216-4b01-a119-64c995783382 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:07.222319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822000e1-2216-4b01-a119-64c995783382 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:07.222847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822000e1-2216-4b01-a119-64c995783382 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:07.224671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 311/612] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:07.230528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234014-b8df-45d1-85ab-b7bbb294ef13 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:07.231054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234014-b8df-45d1-85ab-b7bbb294ef13 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:07.231533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d234014-b8df-45d1-85ab-b7bbb294ef13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:07.250463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4d234014-b8df-45d1-85ab-b7bbb294ef13 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:07.252037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4d234014-b8df-45d1-85ab-b7bbb294ef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:07.301264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe00fa3-4bc4-4045-a366-6375e7dca85d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:07.365397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:07.366028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:07.366309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:07.366583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:07.377658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 312/613] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:33:07.389303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:07.390772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:07.406124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:07.407106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:07.408005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:07.408005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:07.408005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:07.408005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 302/614] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:07.408616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:07.413477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234014-b8df-45d1-85ab-b7bbb294ef13 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:07.562987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d234014-b8df-45d1-85ab-b7bbb294ef13 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:07.564769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:07.606117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:07.606773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:07.607010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:07.607266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:07.607912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:07.608236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:07.609640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:07.631636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 313/615] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:07.637515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:07.759833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedf9ab-586e-442b-b5d0-0437e670ce20 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:07.794779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:07.795414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:07.795694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:07.795968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] PATH_INFO: `/v3/users/swift` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:07.808160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:07.809629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:07.826609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:07.827592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:07.828568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:07.830558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 303/616] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:07.831956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:07.833026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:07.952379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:08.007074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd9c9f-6cb6-4d6b-8640-f7facb8e405e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:08.041275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef73b71-95c9-4203-b00a-c29f6c7a6bc9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:08.070805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:08.072097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.073179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.074073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.075267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:08.075771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:08.078234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:08.083332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c1d1e-69e7-459c-8e34-64de0d207a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:08.084059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1d1e-69e7-459c-8e34-64de0d207a3e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.084510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1d1e-69e7-459c-8e34-64de0d207a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.084858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c1d1e-69e7-459c-8e34-64de0d207a3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.098272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c1d1e-69e7-459c-8e34-64de0d207a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3f7c1d1e-69e7-459c-8e34-64de0d207a3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:08.105046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:08.106019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:08.106835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:08.114861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 314/618] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:08.114861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49ca69-2205-42fc-8105-116ca99b4bec None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.114861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49ca69-2205-42fc-8105-116ca99b4bec None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.114861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49ca69-2205-42fc-8105-116ca99b4bec None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.115296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 304/618] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 31 09:33:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:08.117530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:08.122623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 315/619] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:08.122623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49ca69-2205-42fc-8105-116ca99b4bec None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:08.157555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:08.254687 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c11982-75b4-4960-8d3b-5f82d71e1623 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:08.259663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49ca69-2205-42fc-8105-116ca99b4bec None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:08.271240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:08.302689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:08.303866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.304391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.304610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82973b7b-460e-4b6a-810f-ae43f218204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:08.305243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.305534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973b7b-460e-4b6a-810f-ae43f218204a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.305998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973b7b-460e-4b6a-810f-ae43f218204a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.306441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82973b7b-460e-4b6a-810f-ae43f218204a None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.307435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82973b7b-460e-4b6a-810f-ae43f218204a None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:08.307792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82973b7b-460e-4b6a-810f-ae43f218204a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:08.309257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82973b7b-460e-4b6a-810f-ae43f218204a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:08.319855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 316/620] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:08.320488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214ee7-18a3-47f9-8847-5e52f219ef5a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.320893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214ee7-18a3-47f9-8847-5e52f219ef5a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.321258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5214ee7-18a3-47f9-8847-5e52f219ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.326077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:08.328082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:08.343330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c5214ee7-18a3-47f9-8847-5e52f219ef5a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:08.345157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c5214ee7-18a3-47f9-8847-5e52f219ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:08.351656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:08.353514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:08.355504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:08.355504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:08.355504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:08.357858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 305/621] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:08.358922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:08.434720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 317/622] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:08.435735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5214ee7-18a3-47f9-8847-5e52f219ef5a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:08.453720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:08.522840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06484e-6d6a-450b-a1a8-8033d953517c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:08.559775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5214ee7-18a3-47f9-8847-5e52f219ef5a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:08.592876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f220a-8218-4630-b40a-7099110d253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:08.593729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f220a-8218-4630-b40a-7099110d253e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.593986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f220a-8218-4630-b40a-7099110d253e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.594214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f220a-8218-4630-b40a-7099110d253e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.606151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:08.607476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.607951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.608446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.609281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:08.609771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:08.611386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:08.617829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f220a-8218-4630-b40a-7099110d253e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:08.619801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f220a-8218-4630-b40a-7099110d253e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:08.632635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 318/623] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:08.639216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-085f220a-8218-4630-b40a-7099110d253e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:08.659534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:08.660909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:08.661777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:08.661777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:08.661777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:08.664381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 306/624] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:08.670463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f220a-8218-4630-b40a-7099110d253e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:08.689984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:08.794321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f220a-8218-4630-b40a-7099110d253e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:08.797190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:08.831537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:08.832149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.832458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.832732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.833763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:08.834219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:08.835613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:08.853442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416785aa-324a-4b95-a6a7-eedce1abab04 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:08.853661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 307/625] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:08.854831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:08.907917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:08.909051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:08.909338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:08.909769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:08.919914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:08.921920 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:08.937836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:08.939205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:08.940079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 319/626] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:08.941071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:08.948593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:08.969548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6dd95-702d-473c-8539-385ac78beeed None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.008836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.009539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.009821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.010096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] PATH_INFO: `/v3/users/glance` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.018615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:09.020122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:09.033685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:09.034660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 09:33:09.035593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:09.037483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 308/627] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:09.038404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:09.056612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accc22e-96f1-4e35-8497-681b5b11430e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.092660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4ef61a-073b-4548-8157-8555b3a19c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.093676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef61a-073b-4548-8157-8555b3a19c7f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.093960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef61a-073b-4548-8157-8555b3a19c7f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.094379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ef61a-073b-4548-8157-8555b3a19c7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.096474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:09.107356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4ef61a-073b-4548-8157-8555b3a19c7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ee4ef61a-073b-4548-8157-8555b3a19c7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:09.112613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:09.113532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:09.114370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 320/628] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:09.115685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ae21e-f703-4c05-a614-e2be85d68728 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.115685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ae21e-f703-4c05-a614-e2be85d68728 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.115685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593ae21e-f703-4c05-a614-e2be85d68728 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.116712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 321/629] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:09.121707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ae21e-f703-4c05-a614-e2be85d68728 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:09.157491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e5883-df1d-473d-a447-c0b0beaa134c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.193614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.194215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.194507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.194778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.196052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:09.196637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:09.198089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:09.200594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:09.210747 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 309/630] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:09.212598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:09.231685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593ae21e-f703-4c05-a614-e2be85d68728 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.268356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610123db-c175-4517-b031-d09813cfe152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.268961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610123db-c175-4517-b031-d09813cfe152 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.269246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610123db-c175-4517-b031-d09813cfe152 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.269524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610123db-c175-4517-b031-d09813cfe152 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.270252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610123db-c175-4517-b031-d09813cfe152 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:09.270558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610123db-c175-4517-b031-d09813cfe152 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:09.272000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610123db-c175-4517-b031-d09813cfe152 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:09.289455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 322/631] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 31 09:33:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:09.290677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243edaf8-67e6-4bfe-89e2-22ab35c218a0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.290966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243edaf8-67e6-4bfe-89e2-22ab35c218a0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.291246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243edaf8-67e6-4bfe-89e2-22ab35c218a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.308593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-243edaf8-67e6-4bfe-89e2-22ab35c218a0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:09.310003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-243edaf8-67e6-4bfe-89e2-22ab35c218a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:09.312537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e471f-a393-4be5-b759-d57226d9ac3c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.346485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d42af-fdda-4dbd-96e6-78643b1b7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.347092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d42af-fdda-4dbd-96e6-78643b1b7a7c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.347376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d42af-fdda-4dbd-96e6-78643b1b7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.347676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d42af-fdda-4dbd-96e6-78643b1b7a7c None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.348381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d42af-fdda-4dbd-96e6-78643b1b7a7c None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:09.348688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d42af-fdda-4dbd-96e6-78643b1b7a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:09.350058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d42af-fdda-4dbd-96e6-78643b1b7a7c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:09.356346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:09.358051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 310/632] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:09.359230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199f182-951e-4cf2-a35a-bdf7f28f499c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.359521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199f182-951e-4cf2-a35a-bdf7f28f499c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.359799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5199f182-951e-4cf2-a35a-bdf7f28f499c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.361052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 311/633] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:09.361733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199f182-951e-4cf2-a35a-bdf7f28f499c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:09.380121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 323/634] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:09.381005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243edaf8-67e6-4bfe-89e2-22ab35c218a0 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:09.423448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:09.469605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5199f182-951e-4cf2-a35a-bdf7f28f499c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.485022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243edaf8-67e6-4bfe-89e2-22ab35c218a0 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.505694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682f1bb-baf7-4bd3-89c2-43f6565af624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.506342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682f1bb-baf7-4bd3-89c2-43f6565af624 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.506625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682f1bb-baf7-4bd3-89c2-43f6565af624 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.506893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682f1bb-baf7-4bd3-89c2-43f6565af624 None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/cda7a66a7e054a968f8f633762a1c79b/roles/debd25f091134ad1a9b107790a189b51` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.523030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87249f8-503b-40ba-9ca9-c5f842d598ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.523625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682f1bb-baf7-4bd3-89c2-43f6565af624 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=cda7a66a7e054a968f8f633762a1c79b, role_id=debd25f091134ad1a9b107790a189b51)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:09.523799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87249f8-503b-40ba-9ca9-c5f842d598ec None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.524011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87249f8-503b-40ba-9ca9-c5f842d598ec None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.524282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87249f8-503b-40ba-9ca9-c5f842d598ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.525084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a682f1bb-baf7-4bd3-89c2-43f6565af624 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:09.548211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 312/635] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:09 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/cda7a66a7e054a968f8f633762a1c79b/roles/debd25f091134ad1a9b107790a189b51 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:33:09.548211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682f1bb-baf7-4bd3-89c2-43f6565af624 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:09.586809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:09.610766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87249f8-503b-40ba-9ca9-c5f842d598ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:09.612383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87249f8-503b-40ba-9ca9-c5f842d598ec None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:09.682172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682f1bb-baf7-4bd3-89c2-43f6565af624 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.694115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:09.730208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.730852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.731140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.731415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.742811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:09.744448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:09.745029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 324/636] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:09.749543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd930d5-e5f5-4834-b376-4af733fe8b62 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.749830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd930d5-e5f5-4834-b376-4af733fe8b62 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.750104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd930d5-e5f5-4834-b376-4af733fe8b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:09.765521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:09.766762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:09.767903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:09.767903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:09.767903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:09.771301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 313/637] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:09.771301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:09.771545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8cd930d5-e5f5-4834-b376-4af733fe8b62 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:09.771545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8cd930d5-e5f5-4834-b376-4af733fe8b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:09.848512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 325/638] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:09.849477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd930d5-e5f5-4834-b376-4af733fe8b62 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:09.868735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:09.885347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912abc4-9b39-49d9-b1be-625c9151552a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.936104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82b38-1fcf-466f-a968-e5fc5fd3d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:09.937296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82b38-1fcf-466f-a968-e5fc5fd3d2cc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:09.938276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82b38-1fcf-466f-a968-e5fc5fd3d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:09.938713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82b38-1fcf-466f-a968-e5fc5fd3d2cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:09.959278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa82b38-1fcf-466f-a968-e5fc5fd3d2cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:09.967591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd930d5-e5f5-4834-b376-4af733fe8b62 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1aa82b38-1fcf-466f-a968-e5fc5fd3d2cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:09.968144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:09.969325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:09.970392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:09.972867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 314/639] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:09.977717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82b38-1fcf-466f-a968-e5fc5fd3d2cc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.007353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:10.019522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.020677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.021154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.021589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.035446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.038181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:10.060088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:10.061303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:10.062649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:10.062649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:10.062649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:10.064636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 326/640] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:10.065987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.110322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82b38-1fcf-466f-a968-e5fc5fd3d2cc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.149195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:10.154750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.155367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.155653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.155932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.156651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:10.156940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.158348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.174739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 315/641] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:10.174739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.197013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01816ad4-334e-4aae-bc88-08cf3a38b5c2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.233065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.233672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.233960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.234242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.234902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:10.235204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.236639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.249444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 327/642] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:10.249444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.268326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:10.290786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29809b69-7251-4915-9ccf-496234524fd3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.327553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.328191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.328490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.328770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.329420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:10.329725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.331121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.342945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 316/643] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:10.343768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.373907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354f924-3d13-4184-b169-d0cca7e4a711 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.401220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:10.411171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8855a76-2686-4aec-8aec-c8df977f494f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.411795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8855a76-2686-4aec-8aec-c8df977f494f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.412073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8855a76-2686-4aec-8aec-c8df977f494f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.412371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8855a76-2686-4aec-8aec-c8df977f494f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.423644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8855a76-2686-4aec-8aec-c8df977f494f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-a8855a76-2686-4aec-8aec-c8df977f494f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:10.428929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:10.430135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:10.431047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 328/644] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:10.431787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8855a76-2686-4aec-8aec-c8df977f494f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.460086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae2731-725c-42e9-82bf-758b94822b48 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.497329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.497952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.498229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.498501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.507437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.509471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.512481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:10.522817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:10.523937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 317/645] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:10.525074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.545906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8855a76-2686-4aec-8aec-c8df977f494f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.583898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.584549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.584824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.585103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.596755 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.598354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:10.612662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:10.614211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:10.615293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:10.615293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:10.615293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:10.619015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 329/646] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:10.619853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.642195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d64a30-89ef-47ec-9a52-dfda361805ae None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.667976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:10.681852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.682608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.683169 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.683269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.691327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.692867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:10.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:10.706006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:10.707134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:10.707134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:10.707134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:10.707134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:10.707134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:10.707134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:10.707134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:10.707134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:10.712403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 318/647] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:10.713397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.735746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c5b8-980c-49a3-93d4-9c2e6be195ee None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.775936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.776570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.776854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.777125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.777790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:10.778100 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.779481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.779981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:10.787875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 330/648] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:10.792307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.829692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56176dd3-34ba-44bb-9f8b-3dc1dcbddbc0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.864776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.865372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.865644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.865916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.866668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:10.866990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.868598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.890928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 319/649] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:10.890928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:10.900141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:10.903449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f450b-7855-4dc8-876e-ea8a27cd2a15 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:10.938590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:10.939200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:10.939549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:10.939860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:10.940542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:10.940847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:10.942232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:10.955743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 331/650] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:10.956600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.005841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a9fcb-1b39-4388-a1c0-158cb27a40f2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.024849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:11.042813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.043416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.043695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.043963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.044689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:11.044990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.046402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.064671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 320/651] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:11.064671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.074537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc770457-f30d-49f0-aa18-de262cd81bb1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.111088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.111876 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.112162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.112527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.124298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.125777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:11.142646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:11.143688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:11.144689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:11.144689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:11.144689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:11.149101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 332/652] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:11.149976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.166636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:11.170906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9a13c-2f37-4ed2-9c29-5f4b85f859b8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.207848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a83e7-cc42-4475-a137-6ace3a8ec6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.208417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a83e7-cc42-4475-a137-6ace3a8ec6bc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.208698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a83e7-cc42-4475-a137-6ace3a8ec6bc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.208970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147a83e7-cc42-4475-a137-6ace3a8ec6bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.255304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33962-9dec-4f74-a601-607b9079844a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.259430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:11.283657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a83e7-cc42-4475-a137-6ace3a8ec6bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.285377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147a83e7-cc42-4475-a137-6ace3a8ec6bc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.290683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.291312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.291592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.291860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.300104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.301700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:11.313955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:11.315060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 333/653] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:11.320706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.391788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:11.395785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 321/654] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:11.396815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a83e7-cc42-4475-a137-6ace3a8ec6bc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.427847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce116616-35d0-4067-92af-086cf3747ba9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.463670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.464789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.465212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.465643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.466560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=65c0bf4de3a1442c8b856efbfac436fa) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:11.467004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.468715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.474777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 334/655] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/role_assignments?user.id=65c0bf4de3a1442c8b856efbfac436fa&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:11.475749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.487640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:11.514130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147a83e7-cc42-4475-a137-6ace3a8ec6bc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.552431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.553049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.553327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.553598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.555046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:11.555363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.556819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.575089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 322/656] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:11.575089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.609004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b72e37-569e-467c-b013-0ce3c93ffab2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.648814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268d532-d2e6-4ab9-aa7c-2942288ad88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.649432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268d532-d2e6-4ab9-aa7c-2942288ad88b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.649697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268d532-d2e6-4ab9-aa7c-2942288ad88b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.649969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268d532-d2e6-4ab9-aa7c-2942288ad88b None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.650710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268d532-d2e6-4ab9-aa7c-2942288ad88b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:11.651020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268d532-d2e6-4ab9-aa7c-2942288ad88b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.652589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268d532-d2e6-4ab9-aa7c-2942288ad88b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.660356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:11.674151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 335/657] 10.222.0.18 () {56 vars in 1137 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:11.676001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67b6de-e07a-42ff-8d6f-295de6e50129 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.676001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67b6de-e07a-42ff-8d6f-295de6e50129 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.676206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b67b6de-e07a-42ff-8d6f-295de6e50129 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.677572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 336/658] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:11.678214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67b6de-e07a-42ff-8d6f-295de6e50129 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.701303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b7a17-3c09-4c04-a723-358fe174bd1e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.745146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.745775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.746054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.746327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.753808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:11.758417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.759881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:11.774737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:11.775752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:11.776709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:11.776709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:11.776709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:11.780471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 323/659] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:11.781325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:11.801309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b67b6de-e07a-42ff-8d6f-295de6e50129 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.838610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60a95-497a-4265-8c99-c9466a5d4eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.839231 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60a95-497a-4265-8c99-c9466a5d4eb6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.839510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60a95-497a-4265-8c99-c9466a5d4eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.839775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60a95-497a-4265-8c99-c9466a5d4eb6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.846932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf60a95-497a-4265-8c99-c9466a5d4eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:11.848422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf60a95-497a-4265-8c99-c9466a5d4eb6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-edf60a95-497a-4265-8c99-c9466a5d4eb6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:11.860564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:11.861556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:11.862487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 337/660] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:11.863102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433d51-8c3d-47c0-ab03-317923a46800 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.863170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433d51-8c3d-47c0-ab03-317923a46800 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.863575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9433d51-8c3d-47c0-ab03-317923a46800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.884048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b9433d51-8c3d-47c0-ab03-317923a46800 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:11.885290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b9433d51-8c3d-47c0-ab03-317923a46800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:11.898664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcba1d-39b3-4d63-a04c-36339a421de0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:11.935349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4b3e-bec3-4361-84b0-7b4a6d3eeadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:11.936297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4b3e-bec3-4361-84b0-7b4a6d3eeadd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:11.936578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4b3e-bec3-4361-84b0-7b4a6d3eeadd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:11.936875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a4b3e-bec3-4361-84b0-7b4a6d3eeadd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:11.942593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:11.976538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 338/661] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:11.977520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433d51-8c3d-47c0-ab03-317923a46800 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.004199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:12.016781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a4b3e-bec3-4361-84b0-7b4a6d3eeadd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:12.018323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a4b3e-bec3-4361-84b0-7b4a6d3eeadd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:12.102651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9433d51-8c3d-47c0-ab03-317923a46800 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.139709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:12.140444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:12.140792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:12.141175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:12.141835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:12.142206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:12.143635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:12.159689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 339/662] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:12.159689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.160555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 324/663] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:12.161610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4b3e-bec3-4361-84b0-7b4a6d3eeadd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.209605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:12.268907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743b5f1-2857-40f8-b165-358dc347a6cc None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.282364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:12.293703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a4b3e-bec3-4361-84b0-7b4a6d3eeadd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.306182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:12.306787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:12.307069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:12.307346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:12.308080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:12.308424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:12.309879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:12.328026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 340/664] 10.222.0.18 () {56 vars in 1139 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:12.328871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.333927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220fc09-b946-444b-8992-860311af028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:12.334554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220fc09-b946-444b-8992-860311af028d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:12.334826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220fc09-b946-444b-8992-860311af028d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:12.335119 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220fc09-b946-444b-8992-860311af028d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:12.342173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220fc09-b946-444b-8992-860311af028d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:12.343615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220fc09-b946-444b-8992-860311af028d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8220fc09-b946-444b-8992-860311af028d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:12.355297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:12.356228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:12.357115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 325/665] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:12.357605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220fc09-b946-444b-8992-860311af028d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.442148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552165a6-00e3-46fd-91f8-d26488807a0a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.443772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:12.465122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220fc09-b946-444b-8992-860311af028d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.481918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:12.482558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:12.482835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:12.483140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:12.496029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:12.497592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:12.503791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b9b37-80b6-44bc-ba93-0cea54be25cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:12.504465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9b37-80b6-44bc-ba93-0cea54be25cc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:12.505003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9b37-80b6-44bc-ba93-0cea54be25cc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:12.505003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b9b37-80b6-44bc-ba93-0cea54be25cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:12.513014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:12.514156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:12.515025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:12.515025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:12.515025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:12.515025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 341/666] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:12.515025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.520330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b9b37-80b6-44bc-ba93-0cea54be25cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-359b9b37-80b6-44bc-ba93-0cea54be25cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:12.526140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:12.527180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:12.528268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:12.529579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 326/667] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:12.530172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b9b37-80b6-44bc-ba93-0cea54be25cc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.545981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:12.631282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8662aa1-d156-4fd9-9924-c931f539f1f8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.642395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b9b37-80b6-44bc-ba93-0cea54be25cc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.675308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640dad3-98de-48b3-b514-a9632da2b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:12.676028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640dad3-98de-48b3-b514-a9632da2b99e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:12.676399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640dad3-98de-48b3-b514-a9632da2b99e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:12.676742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640dad3-98de-48b3-b514-a9632da2b99e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:12.678496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:12.679706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:12.680042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:12.680402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:12.681173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:12.681535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:12.683064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:12.700231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 327/668] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:12.700231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.713471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:12.765562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640dad3-98de-48b3-b514-a9632da2b99e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:12.767846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640dad3-98de-48b3-b514-a9632da2b99e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:12.769940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:12.805093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8aafb2-37d5-4df2-a078-4529f8f5b3c4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.845617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:12.846389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:12.846759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:12.847125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:12.847869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:12.848300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:12.849861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:12.862903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 328/669] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:12.863663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.880624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 342/670] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:12.880624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640dad3-98de-48b3-b514-a9632da2b99e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:12.934046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:12.980288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f98f01-ca78-401e-9373-b70893354352 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:12.986758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640dad3-98de-48b3-b514-a9632da2b99e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.012336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:13.019314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.019837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.020118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.020485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.021082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:13.021446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.022991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.023779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.024416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.024694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.024966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.025686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=0365be92a5d54c8ea32fd003a5619a70) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:13.025986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.027410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.031833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 329/671] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:13.032746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.038757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 343/672] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:12 2022] GET /identity/v3/role_assignments?user.id=0365be92a5d54c8ea32fd003a5619a70&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:13.039827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.156440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f606be-8b57-4fa9-81d7-849e515c37d0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.191765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d254a-0d90-4e48-8efa-463642c011d3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.199131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.199766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.200517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.200796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.208851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.211000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.214918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:13.224924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:13.226774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 330/673] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:13.227834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.250361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.251006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.251289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.251563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.265523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.267016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:13.284728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:13.285711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:13.286588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:13.286588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:13.286588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:13.286588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 344/674] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:13.286820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.295427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:13.353702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f6d9bf-c00f-4bd4-b354-d4d1535b0d45 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.403819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d27b-a1fc-4844-9cde-965e50601679 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.405818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.407632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.408071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.408514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.423672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.426070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.445079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:13.445627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:13.446703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:13.447813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:13.447813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:13.447813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:13.448032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.448323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.448686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.449474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:13.449929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.450238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 331/675] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:13.451356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.452020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.466520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 345/676] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:13.467504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.499812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:13.577576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf8be2-c87b-4bf3-87a9-911dc9f17b41 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.577778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12833ab3-3f4a-4861-9898-811ba29ff9e9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.580737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:13.613874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.614378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f5923e-2d85-4e6c-8a67-ad04a5e1631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.614522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.614744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.614989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5923e-2d85-4e6c-8a67-ad04a5e1631b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.615088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.615272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5923e-2d85-4e6c-8a67-ad04a5e1631b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.615547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f5923e-2d85-4e6c-8a67-ad04a5e1631b None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.615653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:13.616503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.616912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5923e-2d85-4e6c-8a67-ad04a5e1631b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:13.617339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5923e-2d85-4e6c-8a67-ad04a5e1631b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.618072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.618698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f5923e-2d85-4e6c-8a67-ad04a5e1631b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.629756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 346/677] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:13.630764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 332/678] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:13.631107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.632633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de932c4-470b-43be-affd-65f9a537993d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.632921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de932c4-470b-43be-affd-65f9a537993d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.633193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de932c4-470b-43be-affd-65f9a537993d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.634640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 333/679] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:13.637287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de932c4-470b-43be-affd-65f9a537993d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.740609 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:13.752431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d8105-e4d4-445c-9db0-c818f7b2b94b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.753715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de932c4-470b-43be-affd-65f9a537993d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:13.788397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf01424-6acd-4ccc-a914-29b3bf5f7353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.789079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01424-6acd-4ccc-a914-29b3bf5f7353 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.789363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01424-6acd-4ccc-a914-29b3bf5f7353 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.789638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf01424-6acd-4ccc-a914-29b3bf5f7353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.790361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf01424-6acd-4ccc-a914-29b3bf5f7353 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=1aca2564475e4df98d4aef031d0b4302) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:13.790670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf01424-6acd-4ccc-a914-29b3bf5f7353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.791609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:13.792147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf01424-6acd-4ccc-a914-29b3bf5f7353 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.792988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.793461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.793923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.798153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 347/680] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/role_assignments?user.id=1aca2564475e4df98d4aef031d0b4302&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:13.799329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4911a-01ed-4b8e-a7f7-6993b36531d2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:13.799610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4911a-01ed-4b8e-a7f7-6993b36531d2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:13.799889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4911a-01ed-4b8e-a7f7-6993b36531d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:13.813618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:13.815391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:13.826406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a4b4911a-01ed-4b8e-a7f7-6993b36531d2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:13.827966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a4b4911a-01ed-4b8e-a7f7-6993b36531d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:13.831610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:13.832677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:13.833626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:13.837980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 334/681] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:13.838978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.871652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:13.918851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 348/682] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:13.919779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4911a-01ed-4b8e-a7f7-6993b36531d2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:13.965178 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe278f-59bc-4793-9628-4214714fa8d8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.008342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:14.009090 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:14.009381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:14.009661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:14.013193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:14.017900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:14.019600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:14.031830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4911a-01ed-4b8e-a7f7-6993b36531d2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:14.032781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:14.033639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:14.034515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 335/683] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:14.041695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:14.075772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:14.076455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:14.076740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:14.077011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:14.077739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:14.078041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:14.080403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:14.099471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 349/684] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 31 09:33:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:14.106255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:14.155664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:14.179230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ccec0-49a2-42a0-9b04-830b18b2e936 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.221623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:14.223419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:14.223733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:14.224013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:14.224769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:14.225696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:14.227306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:14.228361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de061a-3aeb-4b9c-84be-396d8fe7167f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.240628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 336/685] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:14.249211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:14.270518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c66f6-744b-423b-bef3-f436c556f375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:14.271225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c66f6-744b-423b-bef3-f436c556f375 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:14.271509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c66f6-744b-423b-bef3-f436c556f375 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:14.272695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c66f6-744b-423b-bef3-f436c556f375 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:14.288385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:14.364289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c66f6-744b-423b-bef3-f436c556f375 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:14.366899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c66f6-744b-423b-bef3-f436c556f375 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:14.374658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4920d-3a85-49b2-92bb-26a98bee22d4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.410113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:14.410827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:14.411114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:14.411441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:14.412201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=886e718c9d7d48aa8655b8993e2af945) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:14.412561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:14.413993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:14.420590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 337/686] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:14 2022] GET /identity/v3/role_assignments?user.id=886e718c9d7d48aa8655b8993e2af945&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:14.421471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:14.446663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:14.550632 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 350/687] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:14.556948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c66f6-744b-423b-bef3-f436c556f375 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:14.612099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:14.640033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec817d3-5b6f-4ec3-81a9-0b1724a271cf None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.691240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:14.691882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:14.692163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:14.692464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:14.695996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c66f6-744b-423b-bef3-f436c556f375 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.705702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:14.707241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:14.729143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:14.730070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:14.730932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:14.730932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:14.730932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:14.730932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 338/688] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:14.736121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:14.746391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:14.747733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:14.748295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:14.749253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:14.763123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:14.765341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:14.788419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:14.789447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:14.790318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:14.790318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:14.790318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:14.791847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 351/689] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:14.802818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:14.836604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:14.931690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dda806-d45d-4709-b08f-bc3f0975371f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.980540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1e7eb-f49f-4b01-b97e-ac3e684ffa0c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:14.983597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:15.017096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:15.017789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:15.018084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:15.018362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:15.019010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:15.019318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:15.020749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:15.033155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 352/690] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:15.038311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:15.085484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:15.086063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:15.086348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:15.086622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:15.087283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:15.087585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:15.089006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:15.126119 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 339/691] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:15.137178 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:15.155101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9ed0a5-72bf-4623-9691-4c55843747d8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:15.214127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:15.214815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:15.215099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:15.220528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:15.237338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:15.239207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:15.251587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:15.252607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:15.253492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:15.253492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:15.253492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:15.253492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:15.253492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:15.253492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:15.253492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:15.253492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:15.261481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 353/692] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:15.267131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:15.288626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:15.289421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d58a0-73ba-4c75-954b-ff325de91fb4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:15.313993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:15.330671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2b240-bed8-4067-9a5d-88f823d8cfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:15.331277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b240-bed8-4067-9a5d-88f823d8cfcb None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:15.331664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b240-bed8-4067-9a5d-88f823d8cfcb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:15.331939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2b240-bed8-4067-9a5d-88f823d8cfcb None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:15.332820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2b240-bed8-4067-9a5d-88f823d8cfcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:15.334406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2b240-bed8-4067-9a5d-88f823d8cfcb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:15.360432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 340/693] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:33:15 2022] POST /identity/v3/users => generated 254 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:15.369164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bc5f9-c0df-4e43-80f9-20b192ecb3ea None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:15.369503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bc5f9-c0df-4e43-80f9-20b192ecb3ea None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:15.369784 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bc5f9-c0df-4e43-80f9-20b192ecb3ea None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:15.371563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 341/694] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:15 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:15.377194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6dc31-69b3-436e-914a-7b1d4784f199 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:15.377479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6dc31-69b3-436e-914a-7b1d4784f199 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:15.377813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6dc31-69b3-436e-914a-7b1d4784f199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:15.384669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6f579-4330-4603-85bf-1ff6bca5a85f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:15.407218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-85b6dc31-69b3-436e-914a-7b1d4784f199 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:15.416693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-85b6dc31-69b3-436e-914a-7b1d4784f199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:15.420990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:15.421596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:15.421876 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:15.422149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:15.422856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:15.423143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:15.424617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:15.438759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 354/695] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:15.445345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:15.567880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 342/696] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:33:15.591445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:15.619200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14faebf-e4e8-48d3-9af5-95c830a12299 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:15.659035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:15.659642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:15.659923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:15.660219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:15.660951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=cda7a66a7e054a968f8f633762a1c79b) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:15.661254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:15.662834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:15.673879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 355/697] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:15 2022] GET /identity/v3/role_assignments?user.id=cda7a66a7e054a968f8f633762a1c79b&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:15.854222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6dc31-69b3-436e-914a-7b1d4784f199 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:15.971189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6dc31-69b3-436e-914a-7b1d4784f199 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:15.980198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:16.013411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d3c160-0511-4d69-bda7-0ef3950415f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:16.014433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3c160-0511-4d69-bda7-0ef3950415f4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:16.014913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3c160-0511-4d69-bda7-0ef3950415f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:16.015382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d3c160-0511-4d69-bda7-0ef3950415f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:16.027264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d3c160-0511-4d69-bda7-0ef3950415f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f6d3c160-0511-4d69-bda7-0ef3950415f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:16.032598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:16.033540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:16.034369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:16.037541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 343/698] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:16.043199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:16.195763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e451f5-aafb-412f-b555-1be97fc39d28 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:16.242122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ff39-157e-4362-8ed2-a4a37be6dccb None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:16.242726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ff39-157e-4362-8ed2-a4a37be6dccb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:16.243201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e5ff39-157e-4362-8ed2-a4a37be6dccb None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:16.244902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 344/699] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:16.246334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:16.247191 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:16.247667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:16.248139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:16.249091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:16.249610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:16.250099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3881a0-bf4d-4d10-8912-f15ca6b2bea2 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:16.250393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3881a0-bf4d-4d10-8912-f15ca6b2bea2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:16.250670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3881a0-bf4d-4d10-8912-f15ca6b2bea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:16.251961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:16.260513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:16.265183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 356/700] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:16.272050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:16.277060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6e3881a0-bf4d-4d10-8912-f15ca6b2bea2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:16.278265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6e3881a0-bf4d-4d10-8912-f15ca6b2bea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:16.385421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e9a32-1492-4421-be80-f13ba67f57dd None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:16.444801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 345/701] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:16.454251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:16.454900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:16.455182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:16.455458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:16.470320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:16.471790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:16.496588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:16.497538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:16.498482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:16.498482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:16.498482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:16.500190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 357/702] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:16.505087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3881a0-bf4d-4d10-8912-f15ca6b2bea2 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:16.611330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:16.618607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3881a0-bf4d-4d10-8912-f15ca6b2bea2 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:16.662430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:16.663063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:16.663340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:16.663609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:16.664290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:16.664591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:16.665968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:16.679418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 346/703] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:16.685175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:16.798041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:16.822625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:16.861486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8870-c002-4a18-8b89-417f3b1e853e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:16.910247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f4aec6-0ddf-4a2d-a580-4687cfcc2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:16.911477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4aec6-0ddf-4a2d-a580-4687cfcc2bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:16.912008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4aec6-0ddf-4a2d-a580-4687cfcc2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:16.912608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f4aec6-0ddf-4a2d-a580-4687cfcc2bf4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:16.921367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4aec6-0ddf-4a2d-a580-4687cfcc2bf4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:16.922861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f4aec6-0ddf-4a2d-a580-4687cfcc2bf4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-36f4aec6-0ddf-4a2d-a580-4687cfcc2bf4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:16.938560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:16.939657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:16.940686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 358/704] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:33:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:16.941292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d733b2-ac98-4f05-a509-2429081039f8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:16.946587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d733b2-ac98-4f05-a509-2429081039f8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:16.946587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d733b2-ac98-4f05-a509-2429081039f8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:16.947820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 359/705] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:16.948695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d733b2-ac98-4f05-a509-2429081039f8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:16.980057 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39673e-08ad-4137-9b8e-4850dd94178a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:17.025374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71d31d-551a-42bb-bca5-f19c3fc8f276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:17.026065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d31d-551a-42bb-bca5-f19c3fc8f276 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:17.026765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d31d-551a-42bb-bca5-f19c3fc8f276 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:17.027058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71d31d-551a-42bb-bca5-f19c3fc8f276 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:17.027655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d31d-551a-42bb-bca5-f19c3fc8f276 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:17.030563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71d31d-551a-42bb-bca5-f19c3fc8f276 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0c71d31d-551a-42bb-bca5-f19c3fc8f276 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:17.045859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:17.046898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:17.047739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:17.052828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 347/706] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 31 09:33:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:17.054520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2812c-f1e2-4722-a0c5-e5dbec4dc740 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:17.054864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2812c-f1e2-4722-a0c5-e5dbec4dc740 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:17.055160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a2812c-f1e2-4722-a0c5-e5dbec4dc740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:17.080644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c0a2812c-f1e2-4722-a0c5-e5dbec4dc740 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:17.082080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c0a2812c-f1e2-4722-a0c5-e5dbec4dc740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:17.084143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d733b2-ac98-4f05-a509-2429081039f8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:17.099640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:17.101676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:17.130111 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:17.131667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:17.132274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:17.132749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:17.133737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:17.134295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:17.135990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:17.159942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 360/707] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:33:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:17.161257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:17.172259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 348/708] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:17.173448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2812c-f1e2-4722-a0c5-e5dbec4dc740 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:17.357639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d824d3-5716-4cb3-b410-0210b30e4600 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:17.359028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a2812c-f1e2-4722-a0c5-e5dbec4dc740 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:17.400761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:17.402298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:17.403749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:17.404819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:17.405650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:17.408134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:17.409734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:17.421629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 361/709] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 31 09:33:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:17.424877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:17.457549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ec00b-183e-4928-9158-9ba0ccebb60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:17.458344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ec00b-183e-4928-9158-9ba0ccebb60a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:17.459191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ec00b-183e-4928-9158-9ba0ccebb60a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:17.459480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ec00b-183e-4928-9158-9ba0ccebb60a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:17.468106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:17.488887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:17.547377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5a082-b854-4208-98b9-63b588c3798d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:17.557668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ec00b-183e-4928-9158-9ba0ccebb60a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:17.560560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ec00b-183e-4928-9158-9ba0ccebb60a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:17.584616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:17.585223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:17.585503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:17.585777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:17.586635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:17.586743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:17.588063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:17.594257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 362/710] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 31 09:33:17 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:17.595071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:17.693625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 349/711] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:17.701406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ec00b-183e-4928-9158-9ba0ccebb60a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:17.729080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:17.734834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602491d-c9c9-47d6-b8a9-aacc29870133 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:17.780194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:17.780194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:17.780194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:17.780194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] PATH_INFO: `/v3/services/network` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:17.780661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:17.780661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:17.782326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:17.794690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:17.795939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:17.796989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:17.800914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 363/712] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:17 2022] GET /identity/v3/services/network => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:17.805547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:17.887856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ec00b-183e-4928-9158-9ba0ccebb60a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:17.959725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cef1cc8-9052-4034-8f39-07a325c43e0c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:17.960712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:17.961538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:17.962043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:17.962504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:17.985247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:17.987470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:18.009707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:18.010330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.010608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.010881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.011518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] RBAC: Adding query filter params (name=network) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:18.011817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:18.015428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:18.026127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 364/713] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:18.026392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:18.027367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:18.028289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:18.028289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:18.028289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:18.028289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 350/714] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:18.033259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:18.042719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:18.072916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:18.148657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0730cb9c-c9d4-40d4-b10c-ee8883f7c816 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:18.168363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb00075-6243-4cfc-95c2-9a6f7e5375de None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:18.170444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:18.184442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df946376-a325-4636-a281-eb3357edf9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:18.185047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946376-a325-4636-a281-eb3357edf9f6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.185332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946376-a325-4636-a281-eb3357edf9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.185604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df946376-a325-4636-a281-eb3357edf9f6 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.186223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df946376-a325-4636-a281-eb3357edf9f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:18.186520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df946376-a325-4636-a281-eb3357edf9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:18.187977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df946376-a325-4636-a281-eb3357edf9f6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:18.192577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 365/715] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:18.193545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c31c-1b7c-4381-a4d3-f3ace9c76db8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.193825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c31c-1b7c-4381-a4d3-f3ace9c76db8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.194097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952c31c-1b7c-4381-a4d3-f3ace9c76db8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.195432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 366/716] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:18.196379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295573b8-afff-46af-ae3a-0b5ed0beec2b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.196656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295573b8-afff-46af-ae3a-0b5ed0beec2b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.196926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295573b8-afff-46af-ae3a-0b5ed0beec2b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.198295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 367/717] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:18.203809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf500-6ad4-4007-b633-dc812d395a15 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.204092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf500-6ad4-4007-b633-dc812d395a15 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.208550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cf500-6ad4-4007-b633-dc812d395a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.226262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bdbd-a684-4825-8640-70540115bf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:18.226459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-771cf500-6ad4-4007-b633-dc812d395a15 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:18.227335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bdbd-a684-4825-8640-70540115bf42 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.227604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-771cf500-6ad4-4007-b633-dc812d395a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:18.228064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bdbd-a684-4825-8640-70540115bf42 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.228564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bdbd-a684-4825-8640-70540115bf42 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.229461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4bdbd-a684-4825-8640-70540115bf42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:18.230342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4bdbd-a684-4825-8640-70540115bf42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:18.233158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4bdbd-a684-4825-8640-70540115bf42 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:18.250088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 351/718] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:18.251851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609d87-1dbb-42af-b0c8-20f2a837a0fe None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.252421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609d87-1dbb-42af-b0c8-20f2a837a0fe None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.252900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24609d87-1dbb-42af-b0c8-20f2a837a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.274403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-24609d87-1dbb-42af-b0c8-20f2a837a0fe None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:18.275652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-24609d87-1dbb-42af-b0c8-20f2a837a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:18.324483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 368/719] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 09:33:18.325432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cf500-6ad4-4007-b633-dc812d395a15 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:18.352545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:18.364069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 352/720] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:18.438736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cf500-6ad4-4007-b633-dc812d395a15 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:18.477050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:18.477612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.477901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.478174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.485411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:18.486884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:18.499192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:18.500069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:18.500993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 369/721] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:18.506299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609d87-1dbb-42af-b0c8-20f2a837a0fe None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:18.636042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:18.641234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:18.654472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24609d87-1dbb-42af-b0c8-20f2a837a0fe None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:18.725981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:18.726902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.727237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.727453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.728160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:18.728491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:18.729928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:18.747136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 353/722] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:18.747136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:18.776090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:18.802798 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49454ecd-08c3-4ad0-8ae4-5da63d692c03 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:18.842455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf4d5-b960-43ad-a575-e17dae6d247d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:18.843427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf4d5-b960-43ad-a575-e17dae6d247d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.843924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf4d5-b960-43ad-a575-e17dae6d247d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.844449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf4d5-b960-43ad-a575-e17dae6d247d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.857971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbf4d5-b960-43ad-a575-e17dae6d247d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-a0fbf4d5-b960-43ad-a575-e17dae6d247d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:18.863702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:18.865255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:18.866108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:18.867214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3bdd2-39dd-4985-8631-7b67b1f9bd10 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:18.868898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 370/723] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:18.869912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf4d5-b960-43ad-a575-e17dae6d247d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:18.922296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca6fde-5122-4e21-9222-62b4ab679be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:18.923345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca6fde-5122-4e21-9222-62b4ab679be9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:18.923626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca6fde-5122-4e21-9222-62b4ab679be9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:18.923908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca6fde-5122-4e21-9222-62b4ab679be9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:18.939129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca6fde-5122-4e21-9222-62b4ab679be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-5cca6fde-5122-4e21-9222-62b4ab679be9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:18.947339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:18.948558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 354/724] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:18.949390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca6fde-5122-4e21-9222-62b4ab679be9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:18.977696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:19.000572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf4d5-b960-43ad-a575-e17dae6d247d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:19.044749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:19.045708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:19.046263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:19.046725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:19.047629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=0365be92a5d54c8ea32fd003a5619a70) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:19.048210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:19.049926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:19.060532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 371/725] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:18 2022] GET /identity/v3/role_assignments?user.id=0365be92a5d54c8ea32fd003a5619a70&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:19.061807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:19.073977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:19.091861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca6fde-5122-4e21-9222-62b4ab679be9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:19.139100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:19.140984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:19.141272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:19.143094 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:19.143872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:19.144205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:19.147450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:19.171984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 355/726] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:19.186012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:19.238252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead4ade-282c-4a1a-9102-787d609c2a9d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:19.275870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:19.276627 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:19.276913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:19.277187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:19.277875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:19.278152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:19.279533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:19.289471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 372/727] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:19.300195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:19.332136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:19.382927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f562c5-63df-41a9-9424-6e801c21d0a8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:19.396839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:19.418579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41474e47-d46c-4079-ae84-cca2c2ef59d0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:19.456473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:19.456834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:19.457404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:19.457693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:19.458491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:19.459308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:19.459842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:19.460342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:19.473645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:19.476205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:19.482058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:19.483541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:19.494459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:19.495462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:19.496454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:19.496454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:19.496454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:19.498580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 373/728] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:19.504427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:19.511875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:19.512908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:19.513781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:19.513781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:19.513781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:19.513781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 356/729] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:19.521836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:19.618363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9202ad4-f87c-4f1f-949a-ed4b85bb32cf None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:19.653219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:19.681336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8312ab-6fc1-45f3-aa13-762247e7a783 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:19.712095 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:19.713472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:19.714100 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:19.714391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:19.714659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:19.715314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:19.715619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:19.717044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:19.734246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:19.734246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:19.734246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:19.734246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:19.734609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:19.734609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:19.734609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:19.743130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 374/730] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:19.749336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:19.762582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 357/731] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:19.768194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:19.873026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbbaa0-172a-41c5-abd3-41a462c74817 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:19.909115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:19.909745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:19.910026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:19.910299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:19.918746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:19.920366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:19.934538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:19.935535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:19.936504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 375/732] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:33:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:19.942570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:19.985628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:19.986368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831269a-a4b4-4ab4-bf17-d2080839d905 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:20.049295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e16fe0b-1d4b-4c0e-bf98-2c8c4460bcc6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:20.085517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:20.086259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.086434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:20.086548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.086821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.087028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.087405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.087697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.088593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:20.088910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:20.090374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:20.109078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 376/733] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 31 09:33:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:20.109304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:20.110770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:20.117286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:20.131915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:20.132943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:20.133858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:20.139873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 358/734] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:20.144641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:20.207106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:20.242090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:20.249547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd47d6-3c86-42b0-8f22-133685d39ed6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:20.272558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290cb75-4037-4410-b56b-8e0585c01c74 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:20.298553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7501a-4914-423c-b48a-01c41013e616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:20.299724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7501a-4914-423c-b48a-01c41013e616 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.300413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7501a-4914-423c-b48a-01c41013e616 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.300853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7501a-4914-423c-b48a-01c41013e616 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.309780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32893b2f-0735-4487-b294-31f934a26b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:20.310513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32893b2f-0735-4487-b294-31f934a26b3e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.310914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32893b2f-0735-4487-b294-31f934a26b3e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.311286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32893b2f-0735-4487-b294-31f934a26b3e None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.312124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32893b2f-0735-4487-b294-31f934a26b3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:20.312961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32893b2f-0735-4487-b294-31f934a26b3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:20.314212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32893b2f-0735-4487-b294-31f934a26b3e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:20.340101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 359/735] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 31 09:33:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:20.341816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61e995-cbc3-4a78-80d5-88dd6a9d97df None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.342548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61e995-cbc3-4a78-80d5-88dd6a9d97df None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.342548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61e995-cbc3-4a78-80d5-88dd6a9d97df None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.344078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 360/736] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:20.349230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61e995-cbc3-4a78-80d5-88dd6a9d97df None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:20.391439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7501a-4914-423c-b48a-01c41013e616 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:20.393174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7501a-4914-423c-b48a-01c41013e616 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:20.465463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61e995-cbc3-4a78-80d5-88dd6a9d97df None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:20.469324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:20.498652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:20.505887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4829a1-aa51-4e33-905f-a2156665ca38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:20.506496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4829a1-aa51-4e33-905f-a2156665ca38 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.506777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4829a1-aa51-4e33-905f-a2156665ca38 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.507048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4829a1-aa51-4e33-905f-a2156665ca38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.511267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 377/737] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:20.512282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406ab1-a21b-4df7-8fb9-066d269b79ef None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.512605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406ab1-a21b-4df7-8fb9-066d269b79ef None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.512881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc406ab1-a21b-4df7-8fb9-066d269b79ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.530618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-fc406ab1-a21b-4df7-8fb9-066d269b79ef None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:20.531788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fc406ab1-a21b-4df7-8fb9-066d269b79ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:20.579316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4829a1-aa51-4e33-905f-a2156665ca38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:20.580744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4829a1-aa51-4e33-905f-a2156665ca38 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:20.603286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 378/738] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:20.604892 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8a6d9-7388-4620-ac85-24dc32304034 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.605179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8a6d9-7388-4620-ac85-24dc32304034 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.605455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8a6d9-7388-4620-ac85-24dc32304034 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.608295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 379/739] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:20.609160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8a6d9-7388-4620-ac85-24dc32304034 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:20.707199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 361/740] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 09:33:20.708794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510c0e-04c9-4b69-b6c0-7bce5c505198 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.709079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510c0e-04c9-4b69-b6c0-7bce5c505198 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.709355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510c0e-04c9-4b69-b6c0-7bce5c505198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.716613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:20.730376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-77510c0e-04c9-4b69-b6c0-7bce5c505198 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:20.731744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-77510c0e-04c9-4b69-b6c0-7bce5c505198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:20.758850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8a6d9-7388-4620-ac85-24dc32304034 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:20.792451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:20.804413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:20.805276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:20.805690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:20.806090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:20.812667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 362/741] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 09:33:20.813838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77510c0e-04c9-4b69-b6c0-7bce5c505198 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:20.818824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:20.820526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:20.838437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:20.839600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:20.840725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:20.840725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:20.840725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:20.842526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 380/742] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:20.847917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:20.963578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83aadd2-cb7c-48f6-a809-5b5a69176b2e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:20.974668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77510c0e-04c9-4b69-b6c0-7bce5c505198 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:21.000346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.001212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.001644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.002056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.002862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:21.003420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.005796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.019612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.024372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.024372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.024372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.025046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 381/743] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:21.026122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.028209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:21.034092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.035627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:21.055123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:21.056082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:21.056987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:21.056987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:21.056987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:21.057713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 363/744] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:21.058860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.079388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:21.144746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd674ce-de59-4159-880e-8b9bb56d1fcb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:21.181583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a42a1-c47d-4137-a1cc-7a4e39a6e60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.182192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a42a1-c47d-4137-a1cc-7a4e39a6e60a None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.182475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a42a1-c47d-4137-a1cc-7a4e39a6e60a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.182748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a42a1-c47d-4137-a1cc-7a4e39a6e60a None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.182874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fa71f-9b40-4796-96b8-b194c992bea9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:21.183667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a42a1-c47d-4137-a1cc-7a4e39a6e60a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.185076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a42a1-c47d-4137-a1cc-7a4e39a6e60a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.201863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 382/745] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:33:21 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:21.202683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a42a1-c47d-4137-a1cc-7a4e39a6e60a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.239415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.240227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.240512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.240784 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.248639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.250151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:21.263548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:21.264535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:21.265443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 364/746] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:21.265923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.318247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:21.319507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:21.323266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a42a1-c47d-4137-a1cc-7a4e39a6e60a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:21.365787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b762-ee50-4923-84fa-f0894afd9631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.366396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b762-ee50-4923-84fa-f0894afd9631 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.366674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b762-ee50-4923-84fa-f0894afd9631 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.366945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b762-ee50-4923-84fa-f0894afd9631 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.367594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b762-ee50-4923-84fa-f0894afd9631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:21.367896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b762-ee50-4923-84fa-f0894afd9631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.370144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3199b762-ee50-4923-84fa-f0894afd9631 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.381643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 383/747] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:21.383640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674152-91e2-4069-a404-aa27233b43b9 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.383640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674152-91e2-4069-a404-aa27233b43b9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.383640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f674152-91e2-4069-a404-aa27233b43b9 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.386801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 384/748] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:21.386801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f674152-91e2-4069-a404-aa27233b43b9 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.391586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6632a-bcde-4cbb-aba0-a4ea1bea61ea None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:21.428940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006238bd-bab3-48e6-a128-0b5b1e6a55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.429470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006238bd-bab3-48e6-a128-0b5b1e6a55b4 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.429748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006238bd-bab3-48e6-a128-0b5b1e6a55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.430016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006238bd-bab3-48e6-a128-0b5b1e6a55b4 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.430669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006238bd-bab3-48e6-a128-0b5b1e6a55b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.432033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006238bd-bab3-48e6-a128-0b5b1e6a55b4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.449032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 365/749] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:33:21 2022] POST /identity/v3/services => generated 240 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:21.450508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04788-48ef-4c85-a340-64494afd5bb2 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.450976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04788-48ef-4c85-a340-64494afd5bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.451430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f04788-48ef-4c85-a340-64494afd5bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.481142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a5f04788-48ef-4c85-a340-64494afd5bb2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:21.484613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a5f04788-48ef-4c85-a340-64494afd5bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:21.514496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f674152-91e2-4069-a404-aa27233b43b9 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:21.553713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.554426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.554768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.555109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.555888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:21.556391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.558077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.591268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 366/750] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:21.592754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04788-48ef-4c85-a340-64494afd5bb2 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.653768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:21.699871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 385/751] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:21.706067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.741546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:21.743334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f04788-48ef-4c85-a340-64494afd5bb2 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:21.790589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.791225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.791502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.791774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.798735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.800196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:21.812803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:21.813742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:21.815201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 367/752] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:21.821213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.836582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde8a33-ab97-448f-bae7-3fed64a17845 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:21.875847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:21.876482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:21.876762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:21.877086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:21.878153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=c0419feb9d4649a592c1d187ce807faa) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:21.878459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:21.880950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:21.888082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 386/753] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:21 2022] GET /identity/v3/role_assignments?user.id=c0419feb9d4649a592c1d187ce807faa&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:21.931361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:21.970388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:21.981637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac36b53-44af-4b41-adb9-304f17847da9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:22.036545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:22.061742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4959-5cde-48c4-9e85-bfd9823b7b07 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:22.073007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:22.074011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:22.074438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:22.074884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:22.075753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:22.076242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:22.078096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:22.103699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 368/754] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:22.110556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:22.110691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed164c9-86da-4252-bf05-1590a91e5e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:22.111296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed164c9-86da-4252-bf05-1590a91e5e56 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:22.111576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed164c9-86da-4252-bf05-1590a91e5e56 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:22.111850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed164c9-86da-4252-bf05-1590a91e5e56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:22.124775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed164c9-86da-4252-bf05-1590a91e5e56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3ed164c9-86da-4252-bf05-1590a91e5e56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:22.131590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:22.132631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:22.133506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 387/755] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:22.143154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed164c9-86da-4252-bf05-1590a91e5e56 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:22.247947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed164c9-86da-4252-bf05-1590a91e5e56 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:22.275156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951045db-8582-4e2a-8b1f-6de690c2890a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:22.319248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:22.322446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:22.322918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:22.323397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:22.324451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:22.325681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:22.327860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:22.338406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:22.342743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:22.344460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:22.344460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:22.344460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:22.344811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=cda7a66a7e054a968f8f633762a1c79b) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:22.345111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:22.346524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:22.353557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 369/756] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:22 2022] GET /identity/v3/role_assignments?user.id=cda7a66a7e054a968f8f633762a1c79b&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:22.354155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 388/757] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:22.366837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:22.400613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:22.540778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfadfd7-0cb2-463c-be9f-779302f2e6a0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:22.587100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:22.588144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:22.588655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:22.589152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:22.612486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:22.615011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:22.633791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:22.634757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:22.635636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:22.635636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:22.635636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:22.637744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 370/758] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:22.643562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:22.807094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17988f0b-9284-4206-874a-f44f1b33bbcb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:22.852630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:22.853614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:22.854099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:22.854574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:22.855421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:22.855932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:22.857543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:22.871497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 389/759] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:22.877446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:22.962172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:23.010338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bff2087-45e8-48fe-ba68-c87776f5afa9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:23.055301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:23.056313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:23.056802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:23.057331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:23.065727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:23.068156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:23.080093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:23.081059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:23.082125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:23.084644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 371/760] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:33:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:23.090500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:23.155573 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:23.199623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05420e-fdf0-43f1-b749-cfb5f9651179 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:23.234557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:23.235485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:23.236008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:23.236509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:23.237487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:23.238536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:23.240350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:23.264485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:23.265200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 390/761] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:33:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:23.385496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c6c825-5a48-4ee2-92df-cd691184eed9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:23.421022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:23.434950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c72623-ae19-48a2-82a1-39f205af4b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:23.435938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c72623-ae19-48a2-82a1-39f205af4b40 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:23.436466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c72623-ae19-48a2-82a1-39f205af4b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:23.436972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c72623-ae19-48a2-82a1-39f205af4b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:23.460854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c72623-ae19-48a2-82a1-39f205af4b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:23.462681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c72623-ae19-48a2-82a1-39f205af4b40 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-28c72623-ae19-48a2-82a1-39f205af4b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:23.481004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:23.481973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:23.482846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:23.482846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:23.482846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:23.484668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 372/762] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:23.491356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:23.599067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f8b4-2bd3-41f2-8eb6-17995dac905d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:23.599719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f8b4-2bd3-41f2-8eb6-17995dac905d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:23.600272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94f8b4-2bd3-41f2-8eb6-17995dac905d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:23.601893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 373/763] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:23.617001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f062da-aefa-45fc-8b38-9bac64a73158 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:23.625762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1b97-7804-4dd2-9ba7-85625a2d34d7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:23.626302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1b97-7804-4dd2-9ba7-85625a2d34d7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:23.626801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b1b97-7804-4dd2-9ba7-85625a2d34d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:23.648644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:23.649113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ed8b1b97-7804-4dd2-9ba7-85625a2d34d7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:23.650659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ed8b1b97-7804-4dd2-9ba7-85625a2d34d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:23.697444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:23.698051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:23.698329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:23.698601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:23.699242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:23.699541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:23.700940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:23.728734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 374/764] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:23.734667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 391/765] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:23.740637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1b97-7804-4dd2-9ba7-85625a2d34d7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:23.840796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b1b97-7804-4dd2-9ba7-85625a2d34d7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:23.859802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:23.891581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e544d-a473-4f4d-900b-6c69fd492d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:23.892236 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e544d-a473-4f4d-900b-6c69fd492d67 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:23.892519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e544d-a473-4f4d-900b-6c69fd492d67 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:23.892789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e544d-a473-4f4d-900b-6c69fd492d67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:23.900329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e544d-a473-4f4d-900b-6c69fd492d67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:23.901707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501e544d-a473-4f4d-900b-6c69fd492d67 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-501e544d-a473-4f4d-900b-6c69fd492d67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:23.921624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:23.922532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:23.923411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 375/766] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:23.931821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:23.996538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7544d-440d-4c1f-b3a8-edfc0c90ae6e None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:23.996862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7544d-440d-4c1f-b3a8-edfc0c90ae6e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:23.997096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7544d-440d-4c1f-b3a8-edfc0c90ae6e None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:23.998831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 376/767] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:24.004737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088601c-3496-4890-bb24-8326ebc2edc5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.005022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088601c-3496-4890-bb24-8326ebc2edc5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.005295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088601c-3496-4890-bb24-8326ebc2edc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.029919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5088601c-3496-4890-bb24-8326ebc2edc5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:24.031113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5088601c-3496-4890-bb24-8326ebc2edc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:24.112273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661c267-8618-4d15-a8de-d24e45e847e0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:24.119158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 377/768] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:24.120424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088601c-3496-4890-bb24-8326ebc2edc5 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:24.186620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:24.187591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.188121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.188653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.189549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:24.190163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:24.197211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:24.223087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 392/769] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:24.224492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:24.278243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:24.296550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:24.300767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088601c-3496-4890-bb24-8326ebc2edc5 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:24.365252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:24.366023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.366320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.366595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.367192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:24.368782 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:24.379412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:24.380422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:24.381347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 378/770] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 31 09:33:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:24.387286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:24.398532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc5f92-cbab-450c-b9ca-2f3875ba71e2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:24.447043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a17e-7ce0-42f8-9a04-d4d9bd307ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:24.447628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a17e-7ce0-42f8-9a04-d4d9bd307ba6 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.447911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a17e-7ce0-42f8-9a04-d4d9bd307ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.448200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a17e-7ce0-42f8-9a04-d4d9bd307ba6 None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/0365be92a5d54c8ea32fd003a5619a70/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.450124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7a17e-7ce0-42f8-9a04-d4d9bd307ba6 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=0365be92a5d54c8ea32fd003a5619a70, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:24.451575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7a17e-7ce0-42f8-9a04-d4d9bd307ba6 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:24.467694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 393/771] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:24 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/0365be92a5d54c8ea32fd003a5619a70/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:33:24.468672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a17e-7ce0-42f8-9a04-d4d9bd307ba6 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:24.547217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ed8f7-a877-493d-93e2-bd54d44567bd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:24.580644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:24.583820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a17e-7ce0-42f8-9a04-d4d9bd307ba6 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:24.622471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:24.623322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.623795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.624190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.624872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:24.626496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:24.637071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:24.638131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:24.638965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:24.639698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73142b-8247-4c0f-8fcc-6bed3a8b1734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:24.639698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73142b-8247-4c0f-8fcc-6bed3a8b1734 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.639698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73142b-8247-4c0f-8fcc-6bed3a8b1734 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.639907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 394/772] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:24 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:24.639980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73142b-8247-4c0f-8fcc-6bed3a8b1734 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.639980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73142b-8247-4c0f-8fcc-6bed3a8b1734 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:24.639980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73142b-8247-4c0f-8fcc-6bed3a8b1734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:24.644195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73142b-8247-4c0f-8fcc-6bed3a8b1734 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:24.646591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:24.646881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 379/773] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 31 09:33:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:24.649816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468544e-cc3e-43cb-bcb1-68f6a1f50d54 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.650097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468544e-cc3e-43cb-bcb1-68f6a1f50d54 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.650372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a468544e-cc3e-43cb-bcb1-68f6a1f50d54 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.655945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 380/774] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:24.657006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468544e-cc3e-43cb-bcb1-68f6a1f50d54 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:24.689013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:24.770377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a9341-6397-418d-b2a4-66b0269ad0c7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:24.780878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a468544e-cc3e-43cb-bcb1-68f6a1f50d54 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:24.806571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f1749-f45a-4d8b-bb79-6f964924de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:24.807174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f1749-f45a-4d8b-bb79-6f964924de8a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.807708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f1749-f45a-4d8b-bb79-6f964924de8a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.807979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f1749-f45a-4d8b-bb79-6f964924de8a None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.808638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f1749-f45a-4d8b-bb79-6f964924de8a None admin] RBAC: Adding query filter params (name=network) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:24.808938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f1749-f45a-4d8b-bb79-6f964924de8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:24.810314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f1749-f45a-4d8b-bb79-6f964924de8a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:24.815017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 395/775] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:24.816953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb1b6-68f7-45b3-a52a-ee13cc99781e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.817240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb1b6-68f7-45b3-a52a-ee13cc99781e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.817514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4eb1b6-68f7-45b3-a52a-ee13cc99781e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.820496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 396/776] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:24.820496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211909f-08d2-41fb-ba06-1be958219178 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.820496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211909f-08d2-41fb-ba06-1be958219178 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.820771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6211909f-08d2-41fb-ba06-1be958219178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.826928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:24.827553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.827831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.828101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.828774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:24.829075 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:24.830446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:24.840205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 381/777] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 31 09:33:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:24.840205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:24.840458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6211909f-08d2-41fb-ba06-1be958219178 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:24.840458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6211909f-08d2-41fb-ba06-1be958219178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:24.864811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:24.915344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 397/778] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:24.916980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434248e6-2e64-43c7-8d63-8141ec30882b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:24.917530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434248e6-2e64-43c7-8d63-8141ec30882b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:24.918077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434248e6-2e64-43c7-8d63-8141ec30882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:24.941896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-434248e6-2e64-43c7-8d63-8141ec30882b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:24.943980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-434248e6-2e64-43c7-8d63-8141ec30882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:24.956004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:24.965944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1377d-87bf-4562-9d7e-ca2fb04d3071 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.003463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.004571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.004871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.005149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.005797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] RBAC: Adding query filter params (type=network) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:25.006103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:25.007476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:25.017653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 382/779] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:25.018528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.024360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 398/780] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:25.025340 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434248e6-2e64-43c7-8d63-8141ec30882b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.123897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ba72a-83d8-4f5b-aa67-097d7a66dc00 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.156515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:25.170720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.171344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.171625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.171899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.172637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] RBAC: Adding query filter params (interface=public, service_id=44e8633be54a425a91dd17bff23d94e8, region_id=RegionOne) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:25.172947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:25.174317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:25.191767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434248e6-2e64-43c7-8d63-8141ec30882b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.204720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 383/781] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/endpoints?service_id=44e8633be54a425a91dd17bff23d94e8&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:25.205657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.245961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.246572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.246858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.247137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.247849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] RBAC: Adding query filter params (interface=public, service_id=a0ded064fa88412b9c540cb415dfce21, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:25.248158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:25.249668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:25.257835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 399/782] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/endpoints?service_id=a0ded064fa88412b9c540cb415dfce21&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:25.258566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.268563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:25.330942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b2bff-dc4d-408a-a914-f8509b359b06 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.361994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7e117-52a1-4ae9-9968-8ac0bcc94b9a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.366540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d27a7-4a31-4fbb-bba7-15fc7d56cea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.367420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d27a7-4a31-4fbb-bba7-15fc7d56cea5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.367713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d27a7-4a31-4fbb-bba7-15fc7d56cea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.367998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d27a7-4a31-4fbb-bba7-15fc7d56cea5 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.368648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d27a7-4a31-4fbb-bba7-15fc7d56cea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:25.370033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d27a7-4a31-4fbb-bba7-15fc7d56cea5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:25.375337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 384/783] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:25.376125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d27a7-4a31-4fbb-bba7-15fc7d56cea5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.401266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dca29-0eb8-4fc7-afd7-e6c68c57ac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.402334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dca29-0eb8-4fc7-afd7-e6c68c57ac9e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.402967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dca29-0eb8-4fc7-afd7-e6c68c57ac9e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.403443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245dca29-0eb8-4fc7-afd7-e6c68c57ac9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.424839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245dca29-0eb8-4fc7-afd7-e6c68c57ac9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-245dca29-0eb8-4fc7-afd7-e6c68c57ac9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:25.433612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:25.434665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 400/784] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:25.441816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dca29-0eb8-4fc7-afd7-e6c68c57ac9e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.459475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:25.494010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:25.519242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d27a7-4a31-4fbb-bba7-15fc7d56cea5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.564004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c533d-d7fa-4050-aac3-7d4cf1ac594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.564486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c533d-d7fa-4050-aac3-7d4cf1ac594f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.564825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c533d-d7fa-4050-aac3-7d4cf1ac594f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.565099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c533d-d7fa-4050-aac3-7d4cf1ac594f None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.566321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c533d-d7fa-4050-aac3-7d4cf1ac594f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:25.567718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c533d-d7fa-4050-aac3-7d4cf1ac594f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:25.573742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 385/785] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:25.574689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c533d-d7fa-4050-aac3-7d4cf1ac594f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.575024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245dca29-0eb8-4fc7-afd7-e6c68c57ac9e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.614729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bbec-675d-48a3-903e-1dc3b244bb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.616289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bbec-675d-48a3-903e-1dc3b244bb34 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.616779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bbec-675d-48a3-903e-1dc3b244bb34 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.617257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bbec-675d-48a3-903e-1dc3b244bb34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.631172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136bbec-675d-48a3-903e-1dc3b244bb34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2136bbec-675d-48a3-903e-1dc3b244bb34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:25.636741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:25.637675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:25.638541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:25.641343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 401/786] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:25.657054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bbec-675d-48a3-903e-1dc3b244bb34 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.694880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c533d-d7fa-4050-aac3-7d4cf1ac594f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.735141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.735580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.735859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.736134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.736851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:25.737209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:25.739328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:25.752841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 386/787] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:25.754565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.768522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:25.776672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:25.850115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bbec-675d-48a3-903e-1dc3b244bb34 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.874080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594838-c82a-4aec-a5ca-228c1addc3c2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:25.895653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.896453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.896829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.897201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.898024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:25.898505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:25.900040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:25.914705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 402/788] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:25.916475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:25.920535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:25.921344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:25.921788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:25.922199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:25.935309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:25.937286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:25.953583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:25.954678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:25.955548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:25.955548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:25.955548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:25.962595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 387/789] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:25.965406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:26.038030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de02e-55fa-4a8f-9aae-6daafe39be91 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:26.074346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:26.079757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:26.081004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.081946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.082684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.097776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:26.099376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:26.111592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:26.118777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:26.119722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:26.120638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:26.120638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:26.120638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:26.122195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 403/790] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:26.127173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:26.218993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79475b2b-d6fc-49e5-b1f7-8d17d97ccb8b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:26.241557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851d8d-3724-43b8-8b80-56a805e8a3ba None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:26.264879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:26.265494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.265774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.266019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.266680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:26.266979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:26.268376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:26.297462 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 388/791] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:26.303603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:26.309330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:26.309947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.310237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.310490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.311134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:26.311438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:26.318861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:26.346066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 404/792] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:26.348983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:26.444903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776c8cd-6245-474d-8345-01da50cf2733 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:26.466520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:26.491547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:26.514026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:26.515439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.515913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.516426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.530735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:26.532489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:26.556647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:26.557869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:26.558803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:26.567395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 389/793] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:33:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:26.570748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:26.582773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a89514-3045-4b48-b99c-c6f79f7416ae None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:26.638925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36293ac-cba2-4436-9e5e-b6db34b764a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:26.639583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36293ac-cba2-4436-9e5e-b6db34b764a1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.639844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36293ac-cba2-4436-9e5e-b6db34b764a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.640124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36293ac-cba2-4436-9e5e-b6db34b764a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.649528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36293ac-cba2-4436-9e5e-b6db34b764a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:26.651982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36293ac-cba2-4436-9e5e-b6db34b764a1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-d36293ac-cba2-4436-9e5e-b6db34b764a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:26.668873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:26.669863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:26.671211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 405/794] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:26.671791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f0c74-f29b-433d-bcd7-5e9fbca29174 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.671791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f0c74-f29b-433d-bcd7-5e9fbca29174 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.672195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f0c74-f29b-433d-bcd7-5e9fbca29174 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.679672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 406/795] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:26.680959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f0c74-f29b-433d-bcd7-5e9fbca29174 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:26.710374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26065168-5ced-4068-88bb-22966b138d01 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:26.759284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed16d41-c02e-441d-902f-6e4351590704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:26.759902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16d41-c02e-441d-902f-6e4351590704 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.760264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16d41-c02e-441d-902f-6e4351590704 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.760543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed16d41-c02e-441d-902f-6e4351590704 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.761466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed16d41-c02e-441d-902f-6e4351590704 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:26.762576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed16d41-c02e-441d-902f-6e4351590704 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:26.764047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed16d41-c02e-441d-902f-6e4351590704 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:26.791492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 390/796] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 31 09:33:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:26.791492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288656-aa08-45ac-b9c1-43456e48fe65 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.791492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288656-aa08-45ac-b9c1-43456e48fe65 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.791492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64288656-aa08-45ac-b9c1-43456e48fe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.800683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f0c74-f29b-433d-bcd7-5e9fbca29174 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:26.812151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-64288656-aa08-45ac-b9c1-43456e48fe65 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:26.813924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-64288656-aa08-45ac-b9c1-43456e48fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:26.820527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:26.842053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:26.843059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:26.843538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:26.844008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:26.844949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:26.845524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:26.847792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:26.856641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:26.867683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 407/797] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 31 09:33:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:26.868946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:26.994928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ce24c-181a-4a50-ba0e-d62540bd2862 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.024215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 391/798] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:27.024459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64288656-aa08-45ac-b9c1-43456e48fe65 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.047804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.048707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.049093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.050054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.069905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:27.071460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:27.101630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:27.102664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:27.103546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:27.103546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:27.103546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:27.103546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 408/799] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:27.108514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.131264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64288656-aa08-45ac-b9c1-43456e48fe65 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.142684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:27.196860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.197494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.197772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.198041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.219536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:27.221022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:27.247764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:27.248985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:27.249889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:27.249889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:27.249889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:27.249889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 392/800] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:27.259632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.303592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:27.313566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae22b49-2711-4a29-9f5b-da4740d43206 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.379422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.380387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.380679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.381233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.381891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:27.382200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:27.383861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:27.400332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 409/801] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:27.401287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.423618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262ef28-0b57-431c-8a0d-b82deaba11e4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.467228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.468083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.468493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.468967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.469720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:27.470243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:27.472742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:27.486448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 393/802] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:27.488495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.505581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:27.541484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae1df2-b86b-4eae-ad73-b3315d16eced None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.586792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424048-0833-408a-8bde-d39117704d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.587726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424048-0833-408a-8bde-d39117704d1b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.588208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424048-0833-408a-8bde-d39117704d1b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.588625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3424048-0833-408a-8bde-d39117704d1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.590836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:27.602732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3424048-0833-408a-8bde-d39117704d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-f3424048-0833-408a-8bde-d39117704d1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:27.608093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:27.609052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:27.609875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 410/803] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:27.611165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424048-0833-408a-8bde-d39117704d1b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.618376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be1ab4-3c97-40a7-b8dc-68e24f3da9f6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.657391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13884b3-fb2a-43b1-947c-69554f02aaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.658007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13884b3-fb2a-43b1-947c-69554f02aaf1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.658222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13884b3-fb2a-43b1-947c-69554f02aaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.658493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13884b3-fb2a-43b1-947c-69554f02aaf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.666748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13884b3-fb2a-43b1-947c-69554f02aaf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:27.668813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13884b3-fb2a-43b1-947c-69554f02aaf1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b13884b3-fb2a-43b1-947c-69554f02aaf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:27.680941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:27.682108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:27.682969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 394/804] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:27.684112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ea1f-6791-497b-8224-4c72802acd95 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.684112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ea1f-6791-497b-8224-4c72802acd95 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.684112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24ea1f-6791-497b-8224-4c72802acd95 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.689106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 395/805] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:27.689106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ea1f-6791-497b-8224-4c72802acd95 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.720268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3424048-0833-408a-8bde-d39117704d1b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.759787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.760454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.760736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.761011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.762929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:27.770528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:27.772490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:27.784701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:27.785801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 411/806] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:27.787346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.811743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24ea1f-6791-497b-8224-4c72802acd95 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.849870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b8325-b80c-4ab6-b130-da145ec5f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.850478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8325-b80c-4ab6-b130-da145ec5f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.850762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8325-b80c-4ab6-b130-da145ec5f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.851038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b8325-b80c-4ab6-b130-da145ec5f9a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.851701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b8325-b80c-4ab6-b130-da145ec5f9a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:27.852005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b8325-b80c-4ab6-b130-da145ec5f9a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:27.853402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b8325-b80c-4ab6-b130-da145ec5f9a7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:27.863350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 396/807] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:27.868841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbe1af-c2a7-408d-8fbb-db467a334ffb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.869337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbe1af-c2a7-408d-8fbb-db467a334ffb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.870066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbe1af-c2a7-408d-8fbb-db467a334ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.879016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:27.890463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-89cbe1af-c2a7-408d-8fbb-db467a334ffb None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:27.891668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-89cbe1af-c2a7-408d-8fbb-db467a334ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:27.895585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ee773-c3dd-45f7-9f09-9008a8675461 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:27.929604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:27.930125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:27.930406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:27.930676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:27.931360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:27.931921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:27.933388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:27.945661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 412/808] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:27.946448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:27.960312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 397/809] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:27.961148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbe1af-c2a7-408d-8fbb-db467a334ffb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.011714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:28.059368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37f838-9745-4382-89dc-09b00ba4bfe3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.071215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbe1af-c2a7-408d-8fbb-db467a334ffb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.099271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cf5713-3dbe-4655-b65d-3deba7d1b9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.099875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf5713-3dbe-4655-b65d-3deba7d1b9f0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.100156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf5713-3dbe-4655-b65d-3deba7d1b9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.100460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cf5713-3dbe-4655-b65d-3deba7d1b9f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.101267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf5713-3dbe-4655-b65d-3deba7d1b9f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:28.101692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf5713-3dbe-4655-b65d-3deba7d1b9f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.103195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cf5713-3dbe-4655-b65d-3deba7d1b9f0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.106380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.107009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.107296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.107552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.109436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:28.121132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 413/810] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:28.121132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ad722-570a-4893-9300-37c73b7e5cd5 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.121132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ad722-570a-4893-9300-37c73b7e5cd5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.121132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ad722-570a-4893-9300-37c73b7e5cd5 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.121132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 414/811] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:28.121132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ad722-570a-4893-9300-37c73b7e5cd5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.125505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.126947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:28.142733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:28.144315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:28.145206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:28.145206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:28.145206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:28.145206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 398/812] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:28.145206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.235435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ad722-570a-4893-9300-37c73b7e5cd5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.248684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeccad8-c970-44d2-989d-e6f5e3bf5ec3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.249964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:28.271331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42604514-1ec7-4961-8253-6e19f444912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.271983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42604514-1ec7-4961-8253-6e19f444912c None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.272292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42604514-1ec7-4961-8253-6e19f444912c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.272564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42604514-1ec7-4961-8253-6e19f444912c None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/c0419feb9d4649a592c1d187ce807faa/roles/debd25f091134ad1a9b107790a189b51` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.283068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889d49b-2f7c-4801-bdfb-eba9b51ec0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.283752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889d49b-2f7c-4801-bdfb-eba9b51ec0db None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.284046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889d49b-2f7c-4801-bdfb-eba9b51ec0db None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.284467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f889d49b-2f7c-4801-bdfb-eba9b51ec0db None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/cda7a66a7e054a968f8f633762a1c79b/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.286381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889d49b-2f7c-4801-bdfb-eba9b51ec0db None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=cda7a66a7e054a968f8f633762a1c79b, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.286489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42604514-1ec7-4961-8253-6e19f444912c None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=c0419feb9d4649a592c1d187ce807faa, role_id=debd25f091134ad1a9b107790a189b51)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.287800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f889d49b-2f7c-4801-bdfb-eba9b51ec0db None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.287906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42604514-1ec7-4961-8253-6e19f444912c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.300987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 415/813] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:28 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/c0419feb9d4649a592c1d187ce807faa/roles/debd25f091134ad1a9b107790a189b51 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:33:28.302422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55546b99-099d-4cc3-a622-b7cb04a35119 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.302862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55546b99-099d-4cc3-a622-b7cb04a35119 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.303081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 399/814] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:28 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/cda7a66a7e054a968f8f633762a1c79b/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:33:28.303448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55546b99-099d-4cc3-a622-b7cb04a35119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.303912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889d49b-2f7c-4801-bdfb-eba9b51ec0db None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.342435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-55546b99-099d-4cc3-a622-b7cb04a35119 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:28.344096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-55546b99-099d-4cc3-a622-b7cb04a35119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:28.374474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:28.445803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f889d49b-2f7c-4801-bdfb-eba9b51ec0db None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.464541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 416/815] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:28.465563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55546b99-099d-4cc3-a622-b7cb04a35119 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.504250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.505467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.505948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.506449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.507985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:28.508511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.510044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.531890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 400/816] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:28.538550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.625888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:28.642322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55546b99-099d-4cc3-a622-b7cb04a35119 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.675489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257b9d-3739-4e2b-b9f1-33c8a246c98b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.685601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:28.722339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.722981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.723275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.723548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.734027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.734674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.734955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.735229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.735824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.738050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.739637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.741083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:28.757645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:28.758727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:28.759549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 417/817] 10.222.0.18 () {56 vars in 1129 bytes} [Wed Aug 31 09:33:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:28.769947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:28.777898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:28.779756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 401/818] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:33:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:28.781985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.900243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55981dcb-2952-41e9-85e2-80a9f722d627 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.904996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752c8df-e8ce-4f45-b45f-76062740ea57 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:28.940596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.941207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.941473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.941748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.942470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:28.942786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.944311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.949019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:28.949380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 418/819] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 31 09:33:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:28.949803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:28.950085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:28.950264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.950423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] PATH_INFO: `/v3/services/network` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:28.950934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:28.952425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:28.966053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:28.968395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:28.970455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 402/820] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:28 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:28.973021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:28.985529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:29.012961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:29.074556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307d9bc-e21a-4b0d-91e4-32601adb6733 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.109814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16cc24-9d22-44b1-bd07-c1d989cdcafe None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.113560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.114393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.114853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.115317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.116248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:29.116989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.118616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.138159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 419/821] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:33:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:29.139438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:29.153492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.154239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.154660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.154945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.155585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:29.155887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.157995 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.164770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 403/822] 10.222.0.18 () {56 vars in 1124 bytes} [Wed Aug 31 09:33:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:29.166188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:29.230857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:29.254106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06340c-56d2-49c6-ab1b-683599e07104 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.290052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:29.294097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.294711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.295006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.295293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.296086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] RBAC: Adding query filter params (name=network) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:29.296426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.298405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.301316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88800819-1180-4a55-9e33-3726cf2c2839 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.308228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 420/823] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:29.308228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:29.343194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6431b59-ef6e-4548-a26e-20de4213cad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.344215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431b59-ef6e-4548-a26e-20de4213cad4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.344717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431b59-ef6e-4548-a26e-20de4213cad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.345211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6431b59-ef6e-4548-a26e-20de4213cad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.423187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6431b59-ef6e-4548-a26e-20de4213cad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.425589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6431b59-ef6e-4548-a26e-20de4213cad4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.435649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210d6a6-bbc4-4864-af1a-d50c500482eb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.479982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827cd09-cef5-40ed-ba01-6767a6c0a4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.480632 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cd09-cef5-40ed-ba01-6767a6c0a4af None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.480910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cd09-cef5-40ed-ba01-6767a6c0a4af None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.481192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827cd09-cef5-40ed-ba01-6767a6c0a4af None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.481871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827cd09-cef5-40ed-ba01-6767a6c0a4af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.483584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827cd09-cef5-40ed-ba01-6767a6c0a4af None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.509662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:29.515201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 421/824] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:33:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:29.516241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827cd09-cef5-40ed-ba01-6767a6c0a4af None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:29.540984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:29.551973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 404/825] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:33:29.558051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6431b59-ef6e-4548-a26e-20de4213cad4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:29.694127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827cd09-cef5-40ed-ba01-6767a6c0a4af None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.707311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6431b59-ef6e-4548-a26e-20de4213cad4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.750194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.750831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.751114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.751386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.766834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.769303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.771931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.772589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.772877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.773152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.774145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] RBAC: Adding query filter params (type=network) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:29.774453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.775891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.785571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 422/826] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:29.790301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:29.791471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:29.792611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:29.792611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:29.792611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:29.793380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:29.794561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 405/827] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:29.800264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:29.861222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:29.874932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:29.922295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a5fde-88a9-4ee9-b2f1-fa19790631cf None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.922531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851933d-6afa-4029-b397-2569d5e303a0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:29.961412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bee6f-58d7-496c-b894-8ebcfc4882a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.962381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bee6f-58d7-496c-b894-8ebcfc4882a2 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.962952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bee6f-58d7-496c-b894-8ebcfc4882a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.963438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bee6f-58d7-496c-b894-8ebcfc4882a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.964341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bee6f-58d7-496c-b894-8ebcfc4882a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.966117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bee6f-58d7-496c-b894-8ebcfc4882a2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.981708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:29.982732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:29.983289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:29.983725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:29.984708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:29.985207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:29.989428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:29.996702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 423/828] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:33:29 2022] POST /identity/v3/endpoints => generated 337 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:30.012555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 406/829] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:30.021422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bee6f-58d7-496c-b894-8ebcfc4882a2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:30.159156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bee6f-58d7-496c-b894-8ebcfc4882a2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:30.180528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:30.207561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:30.208762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:30.209304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:30.209781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:30.224576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:30.226498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:30.242569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:30.243590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:30.244935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:30.244935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:30.244935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:30.244935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:30.244935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:30.244935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:30.244935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:30.244935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:30.246805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 424/830] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:30.253035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:30.368155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9623e-9d0e-4e6d-b7fe-f630da41df29 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:30.375628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:30.410635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff986f5-18db-48ce-871e-7c5cf7eb3b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:30.411164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff986f5-18db-48ce-871e-7c5cf7eb3b0f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:30.411436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff986f5-18db-48ce-871e-7c5cf7eb3b0f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:30.411707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff986f5-18db-48ce-871e-7c5cf7eb3b0f None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:30.412427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff986f5-18db-48ce-871e-7c5cf7eb3b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:30.412730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff986f5-18db-48ce-871e-7c5cf7eb3b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:30.414147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff986f5-18db-48ce-871e-7c5cf7eb3b0f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:30.428579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 407/831] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:30.434753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:30.552769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7138-7755-4e80-a080-bc476b100b35 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:30.564434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535496-e611-420f-83bf-e3a92b345bad None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:30.564795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535496-e611-420f-83bf-e3a92b345bad None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:30.565077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49535496-e611-420f-83bf-e3a92b345bad None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:30.566533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 408/832] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:30.571817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd52c86-1d46-47a5-92ca-dd84d0899966 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:30.572397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd52c86-1d46-47a5-92ca-dd84d0899966 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:30.572893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd52c86-1d46-47a5-92ca-dd84d0899966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:30.592761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-acd52c86-1d46-47a5-92ca-dd84d0899966 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:30.594567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-acd52c86-1d46-47a5-92ca-dd84d0899966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:30.597652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ab4ef-33c2-446a-b1ff-9b5a1640dea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:30.598308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ab4ef-33c2-446a-b1ff-9b5a1640dea7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:30.598593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ab4ef-33c2-446a-b1ff-9b5a1640dea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:30.598868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ab4ef-33c2-446a-b1ff-9b5a1640dea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:30.599589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ab4ef-33c2-446a-b1ff-9b5a1640dea7 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=0365be92a5d54c8ea32fd003a5619a70) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:30.599952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ab4ef-33c2-446a-b1ff-9b5a1640dea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:30.601438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ab4ef-33c2-446a-b1ff-9b5a1640dea7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:30.608043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 425/833] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:30 2022] GET /identity/v3/role_assignments?user.id=0365be92a5d54c8ea32fd003a5619a70&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:30.618216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782768d4-d160-41f3-82f5-2e0cd8972a70 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:30.618529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782768d4-d160-41f3-82f5-2e0cd8972a70 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:30.618779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782768d4-d160-41f3-82f5-2e0cd8972a70 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:30.620348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 426/834] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:30.628030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5281-f856-4dd0-98b4-a813596b6b21 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:30.628339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5281-f856-4dd0-98b4-a813596b6b21 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:30.628618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f5281-f856-4dd0-98b4-a813596b6b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:30.649742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-1c1f5281-f856-4dd0-98b4-a813596b6b21 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:30.651319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1c1f5281-f856-4dd0-98b4-a813596b6b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:30.692290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 409/835] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:30.693851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:30.750637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 427/836] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:30.968028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd52c86-1d46-47a5-92ca-dd84d0899966 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.028374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5281-f856-4dd0-98b4-a813596b6b21 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.070320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:31.078249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd52c86-1d46-47a5-92ca-dd84d0899966 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.115352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7cebf-f378-4dd3-9190-a49f36fa4d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.116282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7cebf-f378-4dd3-9190-a49f36fa4d32 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.116709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7cebf-f378-4dd3-9190-a49f36fa4d32 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.117161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7cebf-f378-4dd3-9190-a49f36fa4d32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.130252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7cebf-f378-4dd3-9190-a49f36fa4d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7ab7cebf-f378-4dd3-9190-a49f36fa4d32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:31.135622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:31.136566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:31.137405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 410/837] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:31.149262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7cebf-f378-4dd3-9190-a49f36fa4d32 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.154976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f5281-f856-4dd0-98b4-a813596b6b21 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.199880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a331852-1aa0-4941-870a-3f4d5c5f9162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.200583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a331852-1aa0-4941-870a-3f4d5c5f9162 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.200864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a331852-1aa0-4941-870a-3f4d5c5f9162 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.201132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a331852-1aa0-4941-870a-3f4d5c5f9162 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.214545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a331852-1aa0-4941-870a-3f4d5c5f9162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-3a331852-1aa0-4941-870a-3f4d5c5f9162 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:31.220158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:31.221630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:31.222462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 428/838] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:31.228842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a331852-1aa0-4941-870a-3f4d5c5f9162 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.260275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:31.295663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7cebf-f378-4dd3-9190-a49f36fa4d32 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.340761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a331852-1aa0-4941-870a-3f4d5c5f9162 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.344061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.344865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.345322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.345763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.346579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:31.347025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:31.348560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:31.359586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 411/839] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:31.365898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.386530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.387144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.387427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.387703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.388806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:31.389020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:31.390002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:31.391407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:31.408652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 429/840] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:31.410714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.501057 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72b698-b180-4592-a734-e86039cedde3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.515145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:31.531588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd77adc-29a0-44ef-8727-dd39e32e1f04 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.543104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.544140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.544641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.545429 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.557861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:31.559640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:31.574837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.575468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.575749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.576026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:31.578704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:31.579682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:31.581155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:31.581155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:31.581155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:31.587716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:31.587999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 412/841] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:31.589078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.589207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:31.608523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:31.609491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:31.610371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:31.610371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:31.610371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:31.610371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 430/842] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:31.616561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.676867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:31.713272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c7500-e2c7-4edc-9471-01501b3065c7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.757100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.757628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.757906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.758174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.758815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:31.759114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:31.760774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:31.764198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aed8cc-bf50-46c5-859d-56780b5bd9a5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.778278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 413/843] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:31.779342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.808525 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf1b4c-b30b-4f34-9f03-7410c78feada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.809739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1b4c-b30b-4f34-9f03-7410c78feada None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.810761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1b4c-b30b-4f34-9f03-7410c78feada None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.811516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf1b4c-b30b-4f34-9f03-7410c78feada None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.812458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf1b4c-b30b-4f34-9f03-7410c78feada None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:31.813222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf1b4c-b30b-4f34-9f03-7410c78feada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:31.816200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf1b4c-b30b-4f34-9f03-7410c78feada None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:31.828455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:31.834418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 431/844] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:31.835807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc6b5-4288-4aef-aa47-39b5bfe169ec None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.836185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc6b5-4288-4aef-aa47-39b5bfe169ec None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.836559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fc6b5-4288-4aef-aa47-39b5bfe169ec None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.840210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 432/845] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:31.841386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc6b5-4288-4aef-aa47-39b5bfe169ec None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:31.896072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1830d76-6b9a-4243-813f-a25689a2b347 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.931072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:31.939607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f794966-134f-46df-9691-0fca78e50dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.940531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794966-134f-46df-9691-0fca78e50dd7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.941432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794966-134f-46df-9691-0fca78e50dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.941905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f794966-134f-46df-9691-0fca78e50dd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.950036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f794966-134f-46df-9691-0fca78e50dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:31.951671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f794966-134f-46df-9691-0fca78e50dd7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:31.954136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4fc6b5-4288-4aef-aa47-39b5bfe169ec None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1f794966-134f-46df-9691-0fca78e50dd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:31.965157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:31.966219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:31.967334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:31.974565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 414/846] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:31.976421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277843-511e-493b-88bb-5e44b618b798 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.976704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277843-511e-493b-88bb-5e44b618b798 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.976978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf277843-511e-493b-88bb-5e44b618b798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.991234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:31.991863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:31.992145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:31.992450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:31.996957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-bf277843-511e-493b-88bb-5e44b618b798 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:31.998271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bf277843-511e-493b-88bb-5e44b618b798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:31.999661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.001141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:32.013963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:32.015047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 433/847] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:33:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:32.015985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.080541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 415/848] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:32.081619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf277843-511e-493b-88bb-5e44b618b798 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.095841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:32.151317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847b72f-c6d8-4925-af40-74c7ddad62ec None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:32.195803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf277843-511e-493b-88bb-5e44b618b798 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:32.197363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:32.199218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.199682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.200099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.201070 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:32.201520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.203101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.220226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:32.228336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 434/849] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:32.239822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.239987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:32.239987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.239987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.239987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.244205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:32.244205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.244205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.266081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 416/850] 10.222.0.18 () {56 vars in 1135 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:32.267772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.364384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d0a246-e23f-4821-b04c-fc420abbacd4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:32.383709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b94a2-fe5d-42d6-bed6-656b53107991 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:32.385183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:32.404770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d93aa-4eb8-4c61-b423-7b4ffd5e0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:32.405514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d93aa-4eb8-4c61-b423-7b4ffd5e0934 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.405894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d93aa-4eb8-4c61-b423-7b4ffd5e0934 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.406174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d93aa-4eb8-4c61-b423-7b4ffd5e0934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.420973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85e62e-82b1-48ae-a9d7-ed43b3d9a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:32.421591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e62e-82b1-48ae-a9d7-ed43b3d9a44e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.421878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e62e-82b1-48ae-a9d7-ed43b3d9a44e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.422144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e62e-82b1-48ae-a9d7-ed43b3d9a44e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.471601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:32.481600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d93aa-4eb8-4c61-b423-7b4ffd5e0934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.483251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d93aa-4eb8-4c61-b423-7b4ffd5e0934 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.499128 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85e62e-82b1-48ae-a9d7-ed43b3d9a44e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.500713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da85e62e-82b1-48ae-a9d7-ed43b3d9a44e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.591818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 435/851] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:33:32.593357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d93aa-4eb8-4c61-b423-7b4ffd5e0934 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.610664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 417/852] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:33:32.612472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85e62e-82b1-48ae-a9d7-ed43b3d9a44e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.614768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:32.694394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:32.708633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d93aa-4eb8-4c61-b423-7b4ffd5e0934 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:32.716256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da85e62e-82b1-48ae-a9d7-ed43b3d9a44e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:32.743397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:32.744190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.744543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.744880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.745527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.746966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.752568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3fac-eec4-4ff1-818a-ab95fa9a2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:32.753644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3fac-eec4-4ff1-818a-ab95fa9a2c1a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.754145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3fac-eec4-4ff1-818a-ab95fa9a2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.754637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3fac-eec4-4ff1-818a-ab95fa9a2c1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:32.756608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:32.757761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:32.758767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 436/853] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:32.759602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.769801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca3fac-eec4-4ff1-818a-ab95fa9a2c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.771272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca3fac-eec4-4ff1-818a-ab95fa9a2c1a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-00ca3fac-eec4-4ff1-818a-ab95fa9a2c1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:32.786030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:32.787104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:32.787987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:32.787987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:32.787987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:32.787987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 418/854] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:32.788516 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d3eb6-0e5f-40ce-9fc7-1b3ec5c9571e None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.788798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d3eb6-0e5f-40ce-9fc7-1b3ec5c9571e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.789068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d3eb6-0e5f-40ce-9fc7-1b3ec5c9571e None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.790294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 419/855] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:32.790988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d3eb6-0e5f-40ce-9fc7-1b3ec5c9571e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.846178 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:32.864280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab355e-5e5f-4cef-bdba-4973c531cb4d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:32.895416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d3eb6-0e5f-40ce-9fc7-1b3ec5c9571e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:32.898029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:32.898661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.898944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.899222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.909773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.911252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.922884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:32.926153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:32.927277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:32.928370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:32.928370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:32.928370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:32.928370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 437/856] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:32.928370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:32.932667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718250a8-6d76-4918-b0d5-429b22aac935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:32.933278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718250a8-6d76-4918-b0d5-429b22aac935 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.933562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718250a8-6d76-4918-b0d5-429b22aac935 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.933837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718250a8-6d76-4918-b0d5-429b22aac935 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.934474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718250a8-6d76-4918-b0d5-429b22aac935 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:32.934776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718250a8-6d76-4918-b0d5-429b22aac935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:32.936186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718250a8-6d76-4918-b0d5-429b22aac935 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:32.941692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 420/857] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:32.942831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16300549-15f1-4c1d-9c46-87cda16152f5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:32.943117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16300549-15f1-4c1d-9c46-87cda16152f5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:32.943397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16300549-15f1-4c1d-9c46-87cda16152f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:32.961599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-16300549-15f1-4c1d-9c46-87cda16152f5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:32.962804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-16300549-15f1-4c1d-9c46-87cda16152f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:33.026829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13602ca9-affa-4f23-ac8c-f4b5698eab39 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.027016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 421/858] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:33.027761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16300549-15f1-4c1d-9c46-87cda16152f5 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.073112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.073709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.073987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.074257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.074895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:33.075193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.076613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.078058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:33.096570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 438/859] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:33.097546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.141162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16300549-15f1-4c1d-9c46-87cda16152f5 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.172325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:33.186748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.187366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.187645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.187920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.188598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:33.189515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.190963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.202778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 422/860] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:33.203411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.212992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f63ff-ebb4-4901-bb34-d93b84044a9b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.247910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.248602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.249041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.249156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.249748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:33.250046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.251954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.268206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 439/861] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:33.268206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.312876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272967bc-865d-472c-ad5b-a84e40e84b30 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.349608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:33.355142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.355919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.356300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.356630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.366300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.367876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:33.384728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:33.385962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:33.386905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 423/862] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:33.387384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.402524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352b8fb-d495-4a91-bf32-2cb6d8835c74 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.445231 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.445859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.446280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.446560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.448684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:33.455520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.457155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:33.468617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:33.469700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 440/863] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:33.476419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.519719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2981a7-a8cf-409b-88a6-8f10da6189d9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.557040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.557881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.558227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.558571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.559225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.560819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:33.570757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:33.571903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:33.573129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 424/864] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:33.573963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.583529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db8f89-240f-4694-b529-c684b33aceeb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.608555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:33.628995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.629609 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.629900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.630180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.630879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:33.631187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.632672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.650831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 441/865] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:33.650831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.693555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbf322-aa28-4b70-9d1f-94661707e590 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.703909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:33.738786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.739398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.739678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.739944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.740675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:33.740981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.742417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.755567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 425/866] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:33.756439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.765923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4488d9-c1c0-476e-9d0b-c36cac88a58c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.805193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.806379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.806845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.807392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.808353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:33.808844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.810397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.815669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 442/867] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:33.816896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.866470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:33.866639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1fa50-b553-46b1-ac8a-f559a8a9276f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:33.902736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec92268-a184-4204-8347-25708ee68999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:33.903337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92268-a184-4204-8347-25708ee68999 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:33.903615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92268-a184-4204-8347-25708ee68999 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:33.903886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec92268-a184-4204-8347-25708ee68999 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:33.904642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec92268-a184-4204-8347-25708ee68999 None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=c0419feb9d4649a592c1d187ce807faa) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:33.904948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec92268-a184-4204-8347-25708ee68999 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:33.906401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec92268-a184-4204-8347-25708ee68999 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:33.912867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 426/868] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/role_assignments?user.id=c0419feb9d4649a592c1d187ce807faa&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:33.913667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec92268-a184-4204-8347-25708ee68999 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:33.951826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:33.960439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d5d69-9554-47d4-b7e1-8f7c215d03f2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:34.015792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9af492-6bed-4689-b619-0781df3d9d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:34.017559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9af492-6bed-4689-b619-0781df3d9d88 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:34.018477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9af492-6bed-4689-b619-0781df3d9d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:34.018971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9af492-6bed-4689-b619-0781df3d9d88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:34.020222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9af492-6bed-4689-b619-0781df3d9d88 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=cda7a66a7e054a968f8f633762a1c79b) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:34.021276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9af492-6bed-4689-b619-0781df3d9d88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:34.023314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9af492-6bed-4689-b619-0781df3d9d88 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:34.033277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 443/869] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/role_assignments?user.id=cda7a66a7e054a968f8f633762a1c79b&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:34.045947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec92268-a184-4204-8347-25708ee68999 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:34.094129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62c669-ba26-4165-8b18-8ea60a48bcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:34.094758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62c669-ba26-4165-8b18-8ea60a48bcec None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:34.095110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62c669-ba26-4165-8b18-8ea60a48bcec None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:34.095558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62c669-ba26-4165-8b18-8ea60a48bcec None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:34.096454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62c669-ba26-4165-8b18-8ea60a48bcec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:34.096773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62c669-ba26-4165-8b18-8ea60a48bcec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:34.098220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62c669-ba26-4165-8b18-8ea60a48bcec None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:34.103815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 427/870] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:33 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:35.196845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bb508-f2cf-4386-aa4c-02919867c370 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:35.197380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bb508-f2cf-4386-aa4c-02919867c370 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:35.197380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bb508-f2cf-4386-aa4c-02919867c370 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:35.198943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 444/871] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:35.205699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2d20-8006-414b-851a-c5cb2eae5286 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:35.206721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2d20-8006-414b-851a-c5cb2eae5286 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:35.207199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb2d20-8006-414b-851a-c5cb2eae5286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:35.226887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a9bb2d20-8006-414b-851a-c5cb2eae5286 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:35.228412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a9bb2d20-8006-414b-851a-c5cb2eae5286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:35.299537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 428/872] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:35.566374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bb508-f2cf-4386-aa4c-02919867c370 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:35.684836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bb508-f2cf-4386-aa4c-02919867c370 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:35.692902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:35.726963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da12263-2f86-4a0e-9571-f50e322c893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:35.727589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12263-2f86-4a0e-9571-f50e322c893e None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:35.727871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12263-2f86-4a0e-9571-f50e322c893e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:35.728145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da12263-2f86-4a0e-9571-f50e322c893e None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:35.728847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da12263-2f86-4a0e-9571-f50e322c893e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:35.730233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da12263-2f86-4a0e-9571-f50e322c893e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:35.747625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 445/873] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:33:35 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:35.991582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c0ca7-6787-471a-a3f5-ea60beb87cce None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:35.992077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c0ca7-6787-471a-a3f5-ea60beb87cce None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:35.992486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c0ca7-6787-471a-a3f5-ea60beb87cce None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:35.994191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 429/874] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:35.999653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251dfe3-0a9e-40af-8d12-04177129ebc7 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:35.999939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251dfe3-0a9e-40af-8d12-04177129ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.000248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251dfe3-0a9e-40af-8d12-04177129ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.019715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4251dfe3-0a9e-40af-8d12-04177129ebc7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:36.020987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4251dfe3-0a9e-40af-8d12-04177129ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:36.039989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088174d4-836b-441e-aab0-63ec75398cca None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.040450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088174d4-836b-441e-aab0-63ec75398cca None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.040823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088174d4-836b-441e-aab0-63ec75398cca None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.042505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 430/875] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:36.047382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb967c9-99f7-48a1-b43c-2d916fd1ac6d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.048347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb967c9-99f7-48a1-b43c-2d916fd1ac6d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.048796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb967c9-99f7-48a1-b43c-2d916fd1ac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.067605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-aeb967c9-99f7-48a1-b43c-2d916fd1ac6d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:36.068971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-aeb967c9-99f7-48a1-b43c-2d916fd1ac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:36.090062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:36.101706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 446/876] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:35 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:36.103121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d41ec-6199-4b6c-b5c8-f292868a3e23 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.103413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d41ec-6199-4b6c-b5c8-f292868a3e23 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.103686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d41ec-6199-4b6c-b5c8-f292868a3e23 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.105242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 447/877] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:36.113723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace5251-4b91-4b79-adfb-aa083a6f823c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.114211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace5251-4b91-4b79-adfb-aa083a6f823c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.114639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace5251-4b91-4b79-adfb-aa083a6f823c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.142024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-aace5251-4b91-4b79-adfb-aa083a6f823c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:36.143526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-aace5251-4b91-4b79-adfb-aa083a6f823c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:36.158623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 431/878] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:36.218650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 448/879] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:36.383518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb967c9-99f7-48a1-b43c-2d916fd1ac6d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:36.422522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace5251-4b91-4b79-adfb-aa083a6f823c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:36.451680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:36.508087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb967c9-99f7-48a1-b43c-2d916fd1ac6d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:36.535600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace5251-4b91-4b79-adfb-aa083a6f823c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:36.543203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ed2dd-5148-4dc2-9a4f-d88b039c0741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:36.543835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed2dd-5148-4dc2-9a4f-d88b039c0741 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.544112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed2dd-5148-4dc2-9a4f-d88b039c0741 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.544408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ed2dd-5148-4dc2-9a4f-d88b039c0741 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.555597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ed2dd-5148-4dc2-9a4f-d88b039c0741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f62ed2dd-5148-4dc2-9a4f-d88b039c0741 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:36.560921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:36.561839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:36.562700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 432/880] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 31 09:33:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:36.564683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ed2dd-5148-4dc2-9a4f-d88b039c0741 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:36.576860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64bf9-a30e-4792-9a62-192b5260675e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:36.577828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64bf9-a30e-4792-9a62-192b5260675e None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.578109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64bf9-a30e-4792-9a62-192b5260675e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.578382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b64bf9-a30e-4792-9a62-192b5260675e None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.579544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b64bf9-a30e-4792-9a62-192b5260675e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:36.581002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b64bf9-a30e-4792-9a62-192b5260675e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:36.584931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:36.598627 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 449/881] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:33:36 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:33:36.599857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64bf9-a30e-4792-9a62-192b5260675e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:36.689950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ed2dd-5148-4dc2-9a4f-d88b039c0741 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:36.718851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:36.752269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b64bf9-a30e-4792-9a62-192b5260675e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:36.757605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:36.758241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.758522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.758794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.759384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:36.760798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:36.772866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:36.774546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:36.775369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 433/882] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:36.780327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:36.799988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:36.800930 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.801429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.801700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.802370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:36.802674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:36.804054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:36.816211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 450/883] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 31 09:33:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:36.821902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:36.877992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:36.906383 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd450a4c-200d-427a-93ad-c2da53c98de1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:36.936285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0012cb-129b-48e3-a147-003a9172d672 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:36.943552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:36.944422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.944848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.945264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.946037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:36.946502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:36.948000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:36.953311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 434/884] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:36.959541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:36.972878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:36.973515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:36.973795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:36.974373 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:36.985838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:36.987604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:36.988275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:37.004453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:37.005439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:37.006323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:37.006323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:37.006323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:37.010913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 451/885] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:37.011895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:37.095154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dffd2-bafb-4a37-a026-b0147428fae4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:37.131102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:37.131708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:37.131985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:37.132218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8594720-f87e-4a3c-b58a-dfe91a56b9c2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:37.132356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:37.132964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:37.133266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:37.134696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:37.146205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 435/886] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:37.173957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:37.174588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:37.174868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:37.175142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:37.175811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:37.176115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:37.177596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:37.196460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 452/887] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:37.198207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:37.209545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:37.316328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50099-b38b-4402-a9a3-c1a8d2b924be None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:37.352161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:37.352812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:37.353087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:37.353354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:37.361158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:37.362601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:37.374227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:37.375176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:37.376388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 436/888] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:33:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:37.381238 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:37.437806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:37.492928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abfd01-f137-4d5b-8d21-ead996b3fb89 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:37.529669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61b505-81a3-4381-a02f-d1ba3aff0980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:37.530274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61b505-81a3-4381-a02f-d1ba3aff0980 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:37.530549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61b505-81a3-4381-a02f-d1ba3aff0980 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:37.530816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61b505-81a3-4381-a02f-d1ba3aff0980 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:37.531544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61b505-81a3-4381-a02f-d1ba3aff0980 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:37.532444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61b505-81a3-4381-a02f-d1ba3aff0980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:37.534159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61b505-81a3-4381-a02f-d1ba3aff0980 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:37.551746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 453/889] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 31 09:33:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:37.557827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:37.624487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:37.666015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cf5b8-9caa-4e03-8c24-b0a76bcf8ea7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:37.702508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e999-1822-44ab-a992-9877501d9aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:37.703111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e999-1822-44ab-a992-9877501d9aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:37.703387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e999-1822-44ab-a992-9877501d9aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:37.704279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8e999-1822-44ab-a992-9877501d9aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:37.774400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e999-1822-44ab-a992-9877501d9aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:37.775764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8e999-1822-44ab-a992-9877501d9aa6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:37.786112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721f28-ea36-473d-9389-4c7af5b73b7b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:37.786706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721f28-ea36-473d-9389-4c7af5b73b7b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:37.787183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94721f28-ea36-473d-9389-4c7af5b73b7b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:37.788983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 454/890] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:37.794151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efe7b-ca9d-408a-b3c5-628f25b40b90 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:37.794682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efe7b-ca9d-408a-b3c5-628f25b40b90 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:37.795154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efe7b-ca9d-408a-b3c5-628f25b40b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:37.817719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0a8efe7b-ca9d-408a-b3c5-628f25b40b90 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:37.819664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0a8efe7b-ca9d-408a-b3c5-628f25b40b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:37.843197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:37.894074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 437/891] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:37 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:33:37.900808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e999-1822-44ab-a992-9877501d9aa6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:37.917009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 455/892] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:37 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:38.009401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8e999-1822-44ab-a992-9877501d9aa6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.045196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.045803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.046086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.046361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.057713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.059156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:38.074125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:38.075040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:38.075916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:38.075916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:38.075916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:38.075916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 438/893] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:38.081734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8efe7b-ca9d-408a-b3c5-628f25b40b90 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.126507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:38.190777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8efe7b-ca9d-408a-b3c5-628f25b40b90 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.195367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.215678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:38.227652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.228294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.228581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.228860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.229574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:38.229881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.231334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.248164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 456/894] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:38.249733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.314935 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09be8a-c0ec-40c6-8580-3f2044663851 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.355994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.356670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:38.357369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.357649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.357922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.358516 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.359812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7f83-9d3f-4f93-9d7c-557fc52aff4f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.360218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:38.370517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:38.372821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:38.374836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 439/895] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:38.384287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.396637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.397320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.397607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.397884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.405297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.407398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:38.419482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:38.421568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:38.423780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:38.423780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:38.423780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:38.423780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:38.423780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:38.423780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:38.423780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:38.423780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:38.425666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 457/896] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:38.426748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.478562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:38.502652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d4556-fbc2-40e1-a89d-37387b8ba6f9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.538447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c81bb6-38fb-469f-9fb9-65c37a4dc961 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.542880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.543696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.544155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.544624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.545457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:38.545936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.548091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.558567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 440/897] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:38.560114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.576584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.577259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.577614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.577960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.579384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:38.579854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.581465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.599891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 458/898] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:38.601200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.624572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:38.680865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430143b-a201-4967-a234-7078ba5d641d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.712029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d1f73-7cad-417a-a3e5-e1e122fb240b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.723086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.724107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.724590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.725967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.726949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:38.730961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.732593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.744388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 441/899] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:38.746048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.755727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bab15-b61c-4372-86f0-f9895d49b98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.756472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bab15-b61c-4372-86f0-f9895d49b98a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.756828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bab15-b61c-4372-86f0-f9895d49b98a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.757175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bab15-b61c-4372-86f0-f9895d49b98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.757989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bab15-b61c-4372-86f0-f9895d49b98a None admin] RBAC: Adding query filter params (role.id=e7314870da404a14972513b6a7c9fcbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=c0419feb9d4649a592c1d187ce807faa) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:38.758369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bab15-b61c-4372-86f0-f9895d49b98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.760005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bab15-b61c-4372-86f0-f9895d49b98a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.763662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:38.768943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 459/900] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/role_assignments?user.id=c0419feb9d4649a592c1d187ce807faa&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=e7314870da404a14972513b6a7c9fcbf => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:38.770363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902ec0f-60c8-40cd-96fd-9edc3b392617 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.770661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902ec0f-60c8-40cd-96fd-9edc3b392617 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.771218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902ec0f-60c8-40cd-96fd-9edc3b392617 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.772707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 460/901] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:38.778287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758241-154c-4ca7-98db-d596e2d7146f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.778579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758241-154c-4ca7-98db-d596e2d7146f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.778862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758241-154c-4ca7-98db-d596e2d7146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.799918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e4758241-154c-4ca7-98db-d596e2d7146f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:38.801195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e4758241-154c-4ca7-98db-d596e2d7146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:38.877965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd1e08-c092-40f6-945b-15d80620fe37 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:38.878932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 461/902] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:38.916776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89e47d-ce50-44f4-9c17-9ae084fa456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:38.917649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e47d-ce50-44f4-9c17-9ae084fa456b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:38.918077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e47d-ce50-44f4-9c17-9ae084fa456b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:38.918492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89e47d-ce50-44f4-9c17-9ae084fa456b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:38.919380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89e47d-ce50-44f4-9c17-9ae084fa456b None admin] RBAC: Adding query filter params (interface=public, service_id=1e5e480b475741459e25ced31edaff13, region_id=RegionOne) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:38.919850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89e47d-ce50-44f4-9c17-9ae084fa456b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:38.921418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89e47d-ce50-44f4-9c17-9ae084fa456b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:38.932384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 442/903] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/endpoints?service_id=1e5e480b475741459e25ced31edaff13&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:38.934347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758241-154c-4ca7-98db-d596e2d7146f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:38.951685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:39.051021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758241-154c-4ca7-98db-d596e2d7146f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:39.092804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f4520-bf2d-44f5-84bd-f0e11d48beaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:39.093621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4520-bf2d-44f5-84bd-f0e11d48beaf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:39.094575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4520-bf2d-44f5-84bd-f0e11d48beaf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:39.094984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f4520-bf2d-44f5-84bd-f0e11d48beaf None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:39.095916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f4520-bf2d-44f5-84bd-f0e11d48beaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:39.097330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f4520-bf2d-44f5-84bd-f0e11d48beaf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:39.103647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 462/904] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:33:38 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:33:39.132529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784072a4-db31-4525-8d92-50033c627bdf None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:39.132708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784072a4-db31-4525-8d92-50033c627bdf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:39.132989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784072a4-db31-4525-8d92-50033c627bdf None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:39.134654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 443/905] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:39.140352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95bf5-7126-45ae-9530-60af41f61c42 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:39.141181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95bf5-7126-45ae-9530-60af41f61c42 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:39.141587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a95bf5-7126-45ae-9530-60af41f61c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:39.152106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784072a4-db31-4525-8d92-50033c627bdf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:39.161755 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-81a95bf5-7126-45ae-9530-60af41f61c42 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:39.162978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-81a95bf5-7126-45ae-9530-60af41f61c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:39.245391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 463/906] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:39.253621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:39.290395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784072a4-db31-4525-8d92-50033c627bdf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:39.327664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:39.328395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:39.328714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:39.328991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:39.329587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:39.330965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:39.340553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:39.341532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:39.342401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 444/907] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 31 09:33:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:39.348678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a95bf5-7126-45ae-9530-60af41f61c42 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:39.359371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:39.459894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a95bf5-7126-45ae-9530-60af41f61c42 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:39.494558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:39.495176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:39.495456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:39.495732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:39.496394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:39.496698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:39.498089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:39.503666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 464/908] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:39.509901 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:39.566271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:39.630899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4f99-da50-41d3-9210-e82ba333d5d2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:39.648322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:39.686831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a1f9f-e807-4190-bf22-4aba18c1e4aa None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:39.687025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:39.687505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:39.688334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:39.692194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:39.692194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:39.692194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:39.692194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:39.694339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:39.704360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 445/909] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:39.707097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:39.742978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2a6bf-28b9-4a98-acf2-20925aff40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:39.743966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a6bf-28b9-4a98-acf2-20925aff40a5 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:39.744496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a6bf-28b9-4a98-acf2-20925aff40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:39.745006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2a6bf-28b9-4a98-acf2-20925aff40a5 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:39.745872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2a6bf-28b9-4a98-acf2-20925aff40a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:39.747532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2a6bf-28b9-4a98-acf2-20925aff40a5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:39.772879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 465/910] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:33:39 2022] POST /identity/v3/services => generated 241 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:33:39.846921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df7b7d-8d33-4adf-806d-9033c3042319 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:39.893625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcfa343-be2f-4a8b-812f-1b6c6db21a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:39.894622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa343-be2f-4a8b-812f-1b6c6db21a93 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:39.895109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa343-be2f-4a8b-812f-1b6c6db21a93 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:39.895585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcfa343-be2f-4a8b-812f-1b6c6db21a93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:39.896553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfa343-be2f-4a8b-812f-1b6c6db21a93 None admin] RBAC: Adding query filter params (interface=public, service_id=d540a240183e4264bb0a104735d7ef7f, region_id=RegionOne) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:39.897108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfa343-be2f-4a8b-812f-1b6c6db21a93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:39.898712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcfa343-be2f-4a8b-812f-1b6c6db21a93 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:39.905544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 446/911] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 31 09:33:39 2022] GET /identity/v3/endpoints?service_id=d540a240183e4264bb0a104735d7ef7f&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:39.912604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2a6bf-28b9-4a98-acf2-20925aff40a5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:40.027137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2a6bf-28b9-4a98-acf2-20925aff40a5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:40.060841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:40.067905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20ee2e-de4f-46b6-a9e8-e5203987b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:40.068816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ee2e-de4f-46b6-a9e8-e5203987b70a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:40.069310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ee2e-de4f-46b6-a9e8-e5203987b70a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:40.069792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ee2e-de4f-46b6-a9e8-e5203987b70a None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:40.070648 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20ee2e-de4f-46b6-a9e8-e5203987b70a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:40.072480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20ee2e-de4f-46b6-a9e8-e5203987b70a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:40.086445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 466/912] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:33:39 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:33:40.866321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16def46b-700a-4f58-ab11-0fb19971b468 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:40.867328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16def46b-700a-4f58-ab11-0fb19971b468 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:40.867836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16def46b-700a-4f58-ab11-0fb19971b468 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:40.869642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 447/913] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:40.875267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f179f99-6e14-4239-b698-320fee2e8124 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:40.876090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f179f99-6e14-4239-b698-320fee2e8124 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:40.876626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f179f99-6e14-4239-b698-320fee2e8124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:40.895409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4f179f99-6e14-4239-b698-320fee2e8124 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:40.896949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4f179f99-6e14-4239-b698-320fee2e8124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:40.975499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 467/914] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:41.103483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d4aa9-4244-41e0-ae74-8f061411db3b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.104132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d4aa9-4244-41e0-ae74-8f061411db3b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.104683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d4aa9-4244-41e0-ae74-8f061411db3b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.106508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 448/915] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:41.111476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3f3b1-3907-463e-8e92-4d9611f0f581 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.111765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3f3b1-3907-463e-8e92-4d9611f0f581 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.112041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3f3b1-3907-463e-8e92-4d9611f0f581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.130439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-99b3f3b1-3907-463e-8e92-4d9611f0f581 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:41.131612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-99b3f3b1-3907-463e-8e92-4d9611f0f581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:41.205494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 468/916] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:41.263770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d4aa9-4244-41e0-ae74-8f061411db3b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:41.329602 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:41.373489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d4aa9-4244-41e0-ae74-8f061411db3b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:41.410269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafe42e-4982-4f9a-94e9-ab025dbdf3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:41.410907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafe42e-4982-4f9a-94e9-ab025dbdf3d9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.411189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafe42e-4982-4f9a-94e9-ab025dbdf3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.411466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafe42e-4982-4f9a-94e9-ab025dbdf3d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.422353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafe42e-4982-4f9a-94e9-ab025dbdf3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9fafe42e-4982-4f9a-94e9-ab025dbdf3d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:41.427352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:41.428339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:41.429902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 449/917] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 31 09:33:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:41.434991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3f3b1-3907-463e-8e92-4d9611f0f581 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:41.486762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafe42e-4982-4f9a-94e9-ab025dbdf3d9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:41.497481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:41.552219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3f3b1-3907-463e-8e92-4d9611f0f581 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:41.592595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:41.593603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.594236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.594737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.595601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:41.596106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:41.597707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:41.606604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 469/918] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 31 09:33:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:41.612507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:41.619297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafe42e-4982-4f9a-94e9-ab025dbdf3d9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:41.645825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:41.668055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:41.668983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.669434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.669963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.670806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:41.672692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:41.683522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:41.684632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 09:33:41.685478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:41.689103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 450/919] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:41.699729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:41.736000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667951c0-0c1e-4fc4-9ba7-452ae4cdf845 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:41.761345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:41.787762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48a7e1-2531-4ad8-8234-e74233a91e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:41.788840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a7e1-2531-4ad8-8234-e74233a91e14 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.789805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a7e1-2531-4ad8-8234-e74233a91e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.790314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48a7e1-2531-4ad8-8234-e74233a91e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.806406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48a7e1-2531-4ad8-8234-e74233a91e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:41.807967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48a7e1-2531-4ad8-8234-e74233a91e14 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:41.815354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094aaca8-5f86-43e9-b986-a05d6712ef4e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-dd48a7e1-2531-4ad8-8234-e74233a91e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:41.822469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:41.823604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:41.824677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:41.824677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:41.824677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:41.828496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 470/920] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:41.830425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773d2b9-5e27-4a3a-a05b-e62ac46e599b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.830707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773d2b9-5e27-4a3a-a05b-e62ac46e599b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.830982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773d2b9-5e27-4a3a-a05b-e62ac46e599b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.832418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 471/921] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:41.836879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773d2b9-5e27-4a3a-a05b-e62ac46e599b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:41.855816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d112a655-9254-4d68-9afa-9d7fd4d8565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:41.856457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a655-9254-4d68-9afa-9d7fd4d8565e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.856737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a655-9254-4d68-9afa-9d7fd4d8565e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.857096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d112a655-9254-4d68-9afa-9d7fd4d8565e None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.857633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a655-9254-4d68-9afa-9d7fd4d8565e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:41.857930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a655-9254-4d68-9afa-9d7fd4d8565e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:41.859510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d112a655-9254-4d68-9afa-9d7fd4d8565e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:41.864375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 451/922] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:41.865712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0598-54e1-441a-8e77-9edff543b328 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.865990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0598-54e1-441a-8e77-9edff543b328 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.866257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b0598-54e1-441a-8e77-9edff543b328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.884941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5f1b0598-54e1-441a-8e77-9edff543b328 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:41.886115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5f1b0598-54e1-441a-8e77-9edff543b328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:41.936791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:41.953739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773d2b9-5e27-4a3a-a05b-e62ac46e599b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:41.964255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 452/923] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:41.964255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0598-54e1-441a-8e77-9edff543b328 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:41.995742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:41.996764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:41.997045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:41.997315 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:41.997954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:41.998251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.000252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.017623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 472/924] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:42.018941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.051174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:42.092150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b0598-54e1-441a-8e77-9edff543b328 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.126310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077a3f0-b84c-4219-991e-ef523261346e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.130076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f36a83-c2de-4578-95a6-41e4661d7407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.130912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f36a83-c2de-4578-95a6-41e4661d7407 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.131414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f36a83-c2de-4578-95a6-41e4661d7407 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.131876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f36a83-c2de-4578-95a6-41e4661d7407 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.132712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f36a83-c2de-4578-95a6-41e4661d7407 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:42.133216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f36a83-c2de-4578-95a6-41e4661d7407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.135714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f36a83-c2de-4578-95a6-41e4661d7407 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.143027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 453/925] 10.222.0.18 () {56 vars in 1114 bytes} [Wed Aug 31 09:33:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:42.145008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd56b8-df86-4505-8563-c383568476fe None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.145008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd56b8-df86-4505-8563-c383568476fe None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.145008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd56b8-df86-4505-8563-c383568476fe None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.147203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 454/926] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:42.148356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd56b8-df86-4505-8563-c383568476fe None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.167516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd7939-559d-439c-813d-df6f8611504b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.168150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7939-559d-439c-813d-df6f8611504b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.168512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7939-559d-439c-813d-df6f8611504b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.168741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd7939-559d-439c-813d-df6f8611504b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.178309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd7939-559d-439c-813d-df6f8611504b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.180040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd7939-559d-439c-813d-df6f8611504b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-0ecd7939-559d-439c-813d-df6f8611504b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:42.192307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:42.193318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:42.194299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:42.198060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 473/927] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:42.199199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7d39-f124-48a0-95fc-2bab778dac96 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.199483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7d39-f124-48a0-95fc-2bab778dac96 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.199759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd7d39-f124-48a0-95fc-2bab778dac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.200248 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:42.219352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bcdd7d39-f124-48a0-95fc-2bab778dac96 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:42.220591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bcdd7d39-f124-48a0-95fc-2bab778dac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:42.263887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd56b8-df86-4505-8563-c383568476fe None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.287558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 474/928] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:42.288432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd7d39-f124-48a0-95fc-2bab778dac96 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.298213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75cc8e-6344-4a64-8d71-4abc60644fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.298820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75cc8e-6344-4a64-8d71-4abc60644fec None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.299103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75cc8e-6344-4a64-8d71-4abc60644fec None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.299376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75cc8e-6344-4a64-8d71-4abc60644fec None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.300040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75cc8e-6344-4a64-8d71-4abc60644fec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.301444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75cc8e-6344-4a64-8d71-4abc60644fec None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.324311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 455/929] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:33:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:33:42.325423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75cc8e-6344-4a64-8d71-4abc60644fec None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.337294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:42.432351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdd7d39-f124-48a0-95fc-2bab778dac96 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.477021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.477634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.477912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.478182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.478913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:42.479212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.480728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.496661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:42.505066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 475/930] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:42.507276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.508940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75cc8e-6344-4a64-8d71-4abc60644fec None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.553489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.554407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.554684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.554951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.555530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.556915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:42.567056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:42.568110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:42.568982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 456/931] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:42.572138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.606213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:42.635599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10df38d-b2e6-4bd0-9d10-5f8427077a01 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.675549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.676202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.676498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.676772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.688984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.690366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.692900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0d21ec-6e6f-4826-87c0-330e91c9667e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:42.705567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:42.706557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:42.707465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:42.707465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:42.707465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:42.707465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 476/932] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:42.707699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.736705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.737428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.737763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.738116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.738797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.740235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:42.749660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:42.752541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:42.753437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 457/933] 10.222.0.18 () {56 vars in 1132 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:42.754216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.784754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:42.829377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58776197-a43b-4c31-8739-dcca4b05856d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.855716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:42.866859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804f1e30-4178-47ae-8c01-1e46130a1da8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:42.867395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.868006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.868323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.868599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.869234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:42.869537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.870935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.876281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 477/934] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:42.876281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.902350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:42.902953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:42.903222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:42.903491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:42.904139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:42.904471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:42.906679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:42.924213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 458/935] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:42.925122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:42.999221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc84f76-a460-44e9-a16c-e8a558bbc445 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.014779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:43.031111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b487285a-71f3-471a-aaeb-40ac1469aeb0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.036444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.037054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.037338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.037613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.038243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:43.038552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.039929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.045256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 478/936] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:43.047022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:43.075323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.076288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.076573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.076848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.078183 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:43.078704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.080164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.085225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 459/937] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:43.085838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:43.112400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:43.164779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b8376-0ebc-467b-be1b-802e16821a83 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.195143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd37c-a5f8-4f7e-a71e-1c6069612610 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.200274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.200905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.201190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.201465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.209202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.210674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:43.222439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:43.223351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 479/938] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:43.224636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:43.239065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.239813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.240141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.240746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.241235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:43.241594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.243108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.253513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 460/939] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:43.254285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:43.270159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:43.326645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24582ce9-67b6-4263-ae3e-f83431c220d8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.340883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:43.363046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a54804-894e-4c9e-8a34-a1779d5b4450 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.363534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.364143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.364504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.364728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.365425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] RBAC: Adding query filter params (interface=public, service_id=6dffd63ca39f49f794741cf5d30b9f8f, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:43.366302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.367115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.377036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 480/940] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 31 09:33:43 2022] GET /identity/v3/endpoints?service_id=6dffd63ca39f49f794741cf5d30b9f8f&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:43.377036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:43.404023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.404890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.405171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.405496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.406960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:43.407269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.408740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.420821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 461/941] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:43.421933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:43.490540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0af5b7-d04a-4181-acf8-3a540e966bdb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.503948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:43.529559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33425cab-1d9c-4e29-8a37-c9db89e2121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.531062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33425cab-1d9c-4e29-8a37-c9db89e2121f None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.531531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33425cab-1d9c-4e29-8a37-c9db89e2121f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.532160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33425cab-1d9c-4e29-8a37-c9db89e2121f None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.532822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5ea9f-7025-4e07-877f-5fe756cd4e65 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.533242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33425cab-1d9c-4e29-8a37-c9db89e2121f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.534802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33425cab-1d9c-4e29-8a37-c9db89e2121f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.555251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 481/942] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:33:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:43.556439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33425cab-1d9c-4e29-8a37-c9db89e2121f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:43.593839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7d29f-8428-4b1f-9f59-44fe3941e92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.594816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d29f-8428-4b1f-9f59-44fe3941e92d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.595278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d29f-8428-4b1f-9f59-44fe3941e92d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.596052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:43.596558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7d29f-8428-4b1f-9f59-44fe3941e92d None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.598793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d29f-8428-4b1f-9f59-44fe3941e92d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.600673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7d29f-8428-4b1f-9f59-44fe3941e92d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.616216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 462/943] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:33:43 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:33:43.691185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33425cab-1d9c-4e29-8a37-c9db89e2121f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:43.735404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4923ce-22bf-4a43-9302-74304165dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:43.736092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4923ce-22bf-4a43-9302-74304165dbc9 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:43.736404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4923ce-22bf-4a43-9302-74304165dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:43.736681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4923ce-22bf-4a43-9302-74304165dbc9 None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/c0419feb9d4649a592c1d187ce807faa/roles/e7314870da404a14972513b6a7c9fcbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:43.739016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4923ce-22bf-4a43-9302-74304165dbc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=c0419feb9d4649a592c1d187ce807faa, role_id=e7314870da404a14972513b6a7c9fcbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:43.740614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4923ce-22bf-4a43-9302-74304165dbc9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:43.758029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 482/944] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:33:43 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/c0419feb9d4649a592c1d187ce807faa/roles/e7314870da404a14972513b6a7c9fcbf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:33:44.367991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec54c3e-e997-4394-88da-f198b70ff02f None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:44.368536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec54c3e-e997-4394-88da-f198b70ff02f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:44.368640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec54c3e-e997-4394-88da-f198b70ff02f None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:44.370149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 463/945] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:44.375918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b8bbb-7845-4327-8ed5-bbf08fb60ba2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:44.376335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b8bbb-7845-4327-8ed5-bbf08fb60ba2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:44.376499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b8bbb-7845-4327-8ed5-bbf08fb60ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:44.394934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-152b8bbb-7845-4327-8ed5-bbf08fb60ba2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:44.396399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-152b8bbb-7845-4327-8ed5-bbf08fb60ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:44.466775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 483/946] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:44.732780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec54c3e-e997-4394-88da-f198b70ff02f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:44.843736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec54c3e-e997-4394-88da-f198b70ff02f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:44.881245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:44.881648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:44.883175 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:44.883175 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:44.883175 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:44.887675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:44.887675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING keystone.server.flask.common [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 09:33:44.904659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:44.906637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.sql.core [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 09:33:44.906637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 09:33:44.906637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [parameters: {'id': '2cf9cf2d832f4037b49a56d330ef6571', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 09:33:44.906637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88101) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2cf9cf2d832f4037b49a56d330ef6571.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2cf9cf2d832f4037b49a56d330ef6571. Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application conn.query(q) Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 09:33:44.914244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application result.read() Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 09:33:44.915191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application next(self.gen) Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application yield resource Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application next(self.gen) Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise self.value Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application session.commit() Aug 31 09:33:44.916366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.session.flush() Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application compat.raise_( Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 09:33:44.917253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 09:33:44.918144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application conn.query(q) Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application result.read() Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 09:33:44.918913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [parameters: {'id': '2cf9cf2d832f4037b49a56d330ef6571', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:44.919776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:44.920748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2cf9cf2d832f4037b49a56d330ef6571. Aug 31 09:33:44.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:44.924689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 464/947] 10.222.0.18 () {60 vars in 1140 bytes} [Wed Aug 31 09:33:44 2022] POST /identity/v3/projects => generated 262 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:44.932934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b8bbb-7845-4327-8ed5-bbf08fb60ba2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:44.956797 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:45.040213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b8bbb-7845-4327-8ed5-bbf08fb60ba2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:45.076377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055c356-7826-42e3-a67b-a8473502e0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:45.077001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055c356-7826-42e3-a67b-a8473502e0a9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:45.077305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055c356-7826-42e3-a67b-a8473502e0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:45.077577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055c356-7826-42e3-a67b-a8473502e0a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:45.084536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055c356-7826-42e3-a67b-a8473502e0a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:45.086001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055c356-7826-42e3-a67b-a8473502e0a9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6055c356-7826-42e3-a67b-a8473502e0a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:45.097520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:45.098430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:45.099331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 484/948] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:45.106633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:45.216642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c0929b-3f69-4ece-9c15-8c0c9c61e261 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:45.253413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72492d3a-3fa0-45e4-b4e8-87e73ff70bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:45.254386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492d3a-3fa0-45e4-b4e8-87e73ff70bdc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:45.254892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492d3a-3fa0-45e4-b4e8-87e73ff70bdc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:45.255360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72492d3a-3fa0-45e4-b4e8-87e73ff70bdc None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:45.256321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72492d3a-3fa0-45e4-b4e8-87e73ff70bdc None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:45.256840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72492d3a-3fa0-45e4-b4e8-87e73ff70bdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:45.258691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72492d3a-3fa0-45e4-b4e8-87e73ff70bdc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:45.280929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 465/949] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:45.599827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef615ee-585b-4bf9-8383-7274f2864d41 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:45.600871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef615ee-585b-4bf9-8383-7274f2864d41 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:45.601356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef615ee-585b-4bf9-8383-7274f2864d41 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:45.603143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 485/950] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:45.608102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab446e2-02ff-40d0-b944-60f3dd90390f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:45.609190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab446e2-02ff-40d0-b944-60f3dd90390f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:45.609474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab446e2-02ff-40d0-b944-60f3dd90390f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:45.628894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7ab446e2-02ff-40d0-b944-60f3dd90390f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:45.630469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7ab446e2-02ff-40d0-b944-60f3dd90390f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:45.634119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a872-fe4f-4d5c-888e-a1893ef984c0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:45.634119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a872-fe4f-4d5c-888e-a1893ef984c0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:45.634119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21a872-fe4f-4d5c-888e-a1893ef984c0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:45.635489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 486/951] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:45.641476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13291d-6089-46ab-ad8c-91c52cfaf9ad None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:45.641476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13291d-6089-46ab-ad8c-91c52cfaf9ad None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:45.641698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13291d-6089-46ab-ad8c-91c52cfaf9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:45.662545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5c13291d-6089-46ab-ad8c-91c52cfaf9ad None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:45.663753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5c13291d-6089-46ab-ad8c-91c52cfaf9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:45.692028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:45.719044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 466/952] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:45.753671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2880-d91b-4868-a953-78153a775fa6 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:45.754253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2880-d91b-4868-a953-78153a775fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:45.754700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d2880-d91b-4868-a953-78153a775fa6 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:45.756231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 467/953] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:45.756976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 487/954] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:45.761551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eea115-fba6-49cb-b618-ad0b060797c6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:45.761866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eea115-fba6-49cb-b618-ad0b060797c6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:45.762213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eea115-fba6-49cb-b618-ad0b060797c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:45.782361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-55eea115-fba6-49cb-b618-ad0b060797c6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:45.783635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-55eea115-fba6-49cb-b618-ad0b060797c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:45.855956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 468/955] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:46.015130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13291d-6089-46ab-ad8c-91c52cfaf9ad None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.031751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:46.037483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eea115-fba6-49cb-b618-ad0b060797c6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.148861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13291d-6089-46ab-ad8c-91c52cfaf9ad None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.156035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eea115-fba6-49cb-b618-ad0b060797c6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.168609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:46.187973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.188634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.188915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.189189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.189802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.191187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.197402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.198030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.198303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.198567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.199141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:46.200411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:46.201480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:46.202552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:46.203369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.203450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 488/956] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:46.203450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:46.215365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:46.216739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:46.218158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 469/957] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:46.218942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.299099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:46.325027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6171b-9ad0-43be-a72d-ad39732a21b9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.325374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be951a80-761b-4047-a8f6-53d8829b7300 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.360885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272275fb-7e35-4094-a074-4a90ec8b804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.361648 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272275fb-7e35-4094-a074-4a90ec8b804c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.361869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.362147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272275fb-7e35-4094-a074-4a90ec8b804c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.362477 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.362593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272275fb-7e35-4094-a074-4a90ec8b804c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.362757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.363026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.363661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] RBAC: Adding query filter params (name=compute) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:46.363956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.365869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.371541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 470/958] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:46.372370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.374729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272275fb-7e35-4094-a074-4a90ec8b804c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-272275fb-7e35-4094-a074-4a90ec8b804c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:46.380457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:46.381644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:46.382493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 489/959] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:46.383215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272275fb-7e35-4094-a074-4a90ec8b804c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.422994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:46.489911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24a3b4-2caa-44f5-93c3-e70dd1ad30ce None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.491721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272275fb-7e35-4094-a074-4a90ec8b804c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.525122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.525728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.526007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.526279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.526910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:46.527211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.528600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.531292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.531791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.532074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.532379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.533010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:46.533314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.536279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 471/960] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:46.536406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.536487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.543764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 490/961] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:46.543764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.544041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:46.670120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb27e-908a-40b1-be92-ace915c0e3b0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.676006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9126c729-8d6b-4d33-9e8d-41f3d1f0acfe None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.677672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:46.718523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.719169 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.720668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.720668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.720668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:46.720891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.723308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.732204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 491/962] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:46.734249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.734872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.735151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.735423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.736100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:46.736438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.739641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.741157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.747458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 472/963] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:46.753046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.832254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:46.867252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38926-3e59-4379-be15-77bcd04d6a2e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.881865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0060f-373b-4b01-99e7-ceb99fb6f198 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:46.906166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.907297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.907802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.908308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.920260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.923059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.927154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737388c-1b10-4b2e-a7d6-965d40a403fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:46.927704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737388c-1b10-4b2e-a7d6-965d40a403fa None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:46.928270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737388c-1b10-4b2e-a7d6-965d40a403fa None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:46.928546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8737388c-1b10-4b2e-a7d6-965d40a403fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:46.929213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737388c-1b10-4b2e-a7d6-965d40a403fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:46.930587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8737388c-1b10-4b2e-a7d6-965d40a403fa None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:46.941992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:46.942989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:46.943885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:46.943885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:46.943885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:46.945643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 473/964] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:46.953207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:46.969125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 492/965] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:33:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:33:46.981543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:47.087242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924bac81-b17a-4a18-9ac8-d5ce74d8dbf6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:47.131813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f1f39-a85a-4538-8c93-c38d8bd73af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:47.132450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1f39-a85a-4538-8c93-c38d8bd73af2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:47.132733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1f39-a85a-4538-8c93-c38d8bd73af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:47.133004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f1f39-a85a-4538-8c93-c38d8bd73af2 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:47.133655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f1f39-a85a-4538-8c93-c38d8bd73af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:47.133955 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f1f39-a85a-4538-8c93-c38d8bd73af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:47.135315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f1f39-a85a-4538-8c93-c38d8bd73af2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:47.151031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 474/966] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:47.157496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737388c-1b10-4b2e-a7d6-965d40a403fa None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:47.270904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8737388c-1b10-4b2e-a7d6-965d40a403fa None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:47.294938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:47.301681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515f8d8-c1b3-43ce-89d2-8c194cc40c38 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:47.301972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515f8d8-c1b3-43ce-89d2-8c194cc40c38 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:47.302234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515f8d8-c1b3-43ce-89d2-8c194cc40c38 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:47.303992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 475/967] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:47.310832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe581b-6dda-41bb-925e-4de59ddc4352 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:47.311162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe581b-6dda-41bb-925e-4de59ddc4352 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:47.311580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe581b-6dda-41bb-925e-4de59ddc4352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:47.312917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:47.313597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:47.313883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:47.314365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:47.324398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:47.326289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:47.332081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-33fe581b-6dda-41bb-925e-4de59ddc4352 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:47.333557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-33fe581b-6dda-41bb-925e-4de59ddc4352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:47.339817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:47.340762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:47.342337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 493/968] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:33:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:47.347333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:47.428822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 476/969] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:47.460513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52478a-5760-4b42-87de-83e6c352b01c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:47.497210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:47.497824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:47.498106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:47.498379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:47.499140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:47.499446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:47.501050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:47.519966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 494/970] 10.222.0.18 () {56 vars in 1149 bytes} [Wed Aug 31 09:33:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:47.525706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe581b-6dda-41bb-925e-4de59ddc4352 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:47.528471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:47.630392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe581b-6dda-41bb-925e-4de59ddc4352 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:47.672553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36653da6-d099-437b-a8b6-f0cf5617f833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:47.673182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36653da6-d099-437b-a8b6-f0cf5617f833 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:47.673523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36653da6-d099-437b-a8b6-f0cf5617f833 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:47.673803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36653da6-d099-437b-a8b6-f0cf5617f833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:47.710136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:47.757349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:47.771373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36653da6-d099-437b-a8b6-f0cf5617f833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:47.772939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36653da6-d099-437b-a8b6-f0cf5617f833 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:47.775909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:47.824213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6b75d-2ced-4f6b-9b84-99f9e5d2be77 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:47.861492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:47.862432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:47.862926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:47.863390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:47.864259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:47.866144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:47.869081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING keystone.server.flask.common [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 09:33:47.883791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.sql.core [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 09:33:47.883791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 09:33:47.883791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [parameters: {'user_id': 'b7f5d0526be645579e77526d52e3f5e6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 09:33:47.883791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88102) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application conn.query(q) Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application result.read() Aug 31 09:33:47.902630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 09:33:47.903576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application next(self.gen) Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application yield resource Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application next(self.gen) Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise self.value Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application session.commit() Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 09:33:47.905857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.session.flush() Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application compat.raise_( Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 09:33:47.906770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 09:33:47.907680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application conn.query(q) Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application result.read() Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 09:33:47.915940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b7f5d0526be645579e77526d52e3f5e6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:47.916850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 09:33:47.917641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 09:33:47.920158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 09:33:47.920158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 09:33:47.920158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 09:33:47.920158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 09:33:47.920158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 09:33:47.920158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:47.921568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 477/971] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:47 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:33:47.921568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36653da6-d099-437b-a8b6-f0cf5617f833 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:47.921959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 495/972] 10.222.0.18 () {60 vars in 1131 bytes} [Wed Aug 31 09:33:47 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:47.923903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:48.022283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36653da6-d099-437b-a8b6-f0cf5617f833 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:48.023980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:48.038645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d384f2-b2d3-48c5-91a3-9d81696372b0 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:48.040846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:48.065335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:48.065970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.066249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.066518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.078549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:48.079889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:48.083792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:48.084703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.085191 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.085655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.094497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:48.095790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:48.096724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:48.097640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:48.097640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:48.097640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:48.099079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:48.100497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 478/973] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:48.102973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:48.113501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:48.114463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 09:33:48.115591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:48.122831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 496/974] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:33:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:48.125055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:48.223868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5042a-5175-4792-b031-7427f208b7a1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:48.242879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0da4e8-041d-4e24-b94b-66191166285e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:48.260640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:48.261250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.261536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.261805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.262556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:48.262861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:48.264897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:48.282415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:48.283423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 479/975] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:48.283782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.284358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:48.284468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.285043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.286011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:48.286507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:48.288402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:48.301161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:48.338423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 497/976] 10.222.0.18 () {56 vars in 1101 bytes} [Wed Aug 31 09:33:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:48.396507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82412903-6d2f-40da-a6c2-c685acf6e252 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:48.436720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:48.437465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.437808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.438085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.445753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:48.447425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:48.461054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:48.462001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:48.463281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 480/977] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:48.469085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:48.497183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:48.587199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3d213-fa7f-497c-96b9-e0630394b4bb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:48.627307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c800fd9-a93f-4280-8175-2240dfc017bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:48.627921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800fd9-a93f-4280-8175-2240dfc017bf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.628291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800fd9-a93f-4280-8175-2240dfc017bf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.628508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c800fd9-a93f-4280-8175-2240dfc017bf None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.629206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800fd9-a93f-4280-8175-2240dfc017bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:48.629513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800fd9-a93f-4280-8175-2240dfc017bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:48.630985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c800fd9-a93f-4280-8175-2240dfc017bf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:48.644203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 498/978] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:48.649513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:48.650692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba185819-7262-49ae-b8c0-33c94b358ba9 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.650985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba185819-7262-49ae-b8c0-33c94b358ba9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.651263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba185819-7262-49ae-b8c0-33c94b358ba9 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.652702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 499/979] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:48.657981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844b0b-7b64-4ea0-be9a-296ec7e40803 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.658335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844b0b-7b64-4ea0-be9a-296ec7e40803 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.658675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10844b0b-7b64-4ea0-be9a-296ec7e40803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.679530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-10844b0b-7b64-4ea0-be9a-296ec7e40803 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:48.681074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-10844b0b-7b64-4ea0-be9a-296ec7e40803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:48.734102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:48.759897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390df8-973b-429a-91e0-a4b75ce0a4b1 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:48.766285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 500/980] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:48.795780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269df7fb-90ef-4d3e-86f1-40fc699c3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:48.796407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df7fb-90ef-4d3e-86f1-40fc699c3371 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:48.796681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df7fb-90ef-4d3e-86f1-40fc699c3371 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:48.796949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269df7fb-90ef-4d3e-86f1-40fc699c3371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:48.797671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269df7fb-90ef-4d3e-86f1-40fc699c3371 None admin] RBAC: Adding query filter params (role.id=e7314870da404a14972513b6a7c9fcbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=c0419feb9d4649a592c1d187ce807faa) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:48.797975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269df7fb-90ef-4d3e-86f1-40fc699c3371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:48.799386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269df7fb-90ef-4d3e-86f1-40fc699c3371 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:48.812203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 481/981] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:48 2022] GET /identity/v3/role_assignments?user.id=c0419feb9d4649a592c1d187ce807faa&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=e7314870da404a14972513b6a7c9fcbf => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:49.006282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aec5f-0901-472f-984e-f6fe7f7b552d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:49.006618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aec5f-0901-472f-984e-f6fe7f7b552d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:49.006857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6aec5f-0901-472f-984e-f6fe7f7b552d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:49.008265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 501/982] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:49.013499 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee78f8-4b19-4ee5-b2e5-34fd222a8d67 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:49.013789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee78f8-4b19-4ee5-b2e5-34fd222a8d67 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:49.014126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee78f8-4b19-4ee5-b2e5-34fd222a8d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:49.032631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c9ee78f8-4b19-4ee5-b2e5-34fd222a8d67 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:49.033807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c9ee78f8-4b19-4ee5-b2e5-34fd222a8d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:49.039374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aec5f-0901-472f-984e-f6fe7f7b552d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:49.054696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:49.104512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 482/983] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:49.156814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6aec5f-0901-472f-984e-f6fe7f7b552d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:49.194399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5ed6-2122-4a80-8a20-ef6511c953a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:49.195070 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5ed6-2122-4a80-8a20-ef6511c953a8 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:49.195544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5ed6-2122-4a80-8a20-ef6511c953a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:49.196012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c5ed6-2122-4a80-8a20-ef6511c953a8 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:49.197268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c5ed6-2122-4a80-8a20-ef6511c953a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:49.199748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c5ed6-2122-4a80-8a20-ef6511c953a8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:49.216212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 502/984] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:33:49 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:33:49.378919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee78f8-4b19-4ee5-b2e5-34fd222a8d67 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:49.445511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:49.482231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee78f8-4b19-4ee5-b2e5-34fd222a8d67 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:49.523545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:49.524201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:49.524482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:49.524752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:49.525328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:49.526683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:49.536393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:49.537379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:49.538222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 483/985] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:49.543582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5ed6-2122-4a80-8a20-ef6511c953a8 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:49.613358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:49.647526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c5ed6-2122-4a80-8a20-ef6511c953a8 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:49.689402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:49.690013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:49.690290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:49.690561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:49.691187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:49.691487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:49.692886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:49.703423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 503/986] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:49.705173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:49.813388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6890d2-c7be-4a73-9d2f-c4f363b74afa None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:49.840038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:49.849427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:49.850031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:49.850305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:49.850571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:49.851199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:49.851494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:49.852890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:49.857760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 484/987] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:49.864042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:49.972655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf174c-3ef4-4617-8a9a-e7c553870cac None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:50.005679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ee76d-00c1-44f2-8eb8-409eb7f4b248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:50.007013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ee76d-00c1-44f2-8eb8-409eb7f4b248 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:50.007013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ee76d-00c1-44f2-8eb8-409eb7f4b248 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:50.007013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ee76d-00c1-44f2-8eb8-409eb7f4b248 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:50.007480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ee76d-00c1-44f2-8eb8-409eb7f4b248 None admin] RBAC: Adding query filter params (interface=admin, service_id=6dffd63ca39f49f794741cf5d30b9f8f, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:50.007779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ee76d-00c1-44f2-8eb8-409eb7f4b248 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:50.009270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753ee76d-00c1-44f2-8eb8-409eb7f4b248 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:50.010721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:50.017492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 504/988] 10.222.0.18 () {56 vars in 1249 bytes} [Wed Aug 31 09:33:49 2022] GET /identity/v3/endpoints?service_id=6dffd63ca39f49f794741cf5d30b9f8f&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:50.022051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:50.120459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d5493-2906-4656-8bfa-ce88ca547648 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:50.153251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07324c41-8374-4959-961b-14cf41664523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:50.153842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07324c41-8374-4959-961b-14cf41664523 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:50.154120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07324c41-8374-4959-961b-14cf41664523 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:50.154436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07324c41-8374-4959-961b-14cf41664523 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:50.155048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07324c41-8374-4959-961b-14cf41664523 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:50.156432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07324c41-8374-4959-961b-14cf41664523 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:50.162804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 485/989] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:33:50 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:33:50.762380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3314f-fb31-4654-931f-8dc29f26de70 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:50.762756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3314f-fb31-4654-931f-8dc29f26de70 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:50.762929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3314f-fb31-4654-931f-8dc29f26de70 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:50.764669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 505/990] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:50.769550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03df2f-6760-46b1-b1cd-378662586be0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:50.769845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03df2f-6760-46b1-b1cd-378662586be0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:50.770124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03df2f-6760-46b1-b1cd-378662586be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:50.789149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9e03df2f-6760-46b1-b1cd-378662586be0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:50.790328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9e03df2f-6760-46b1-b1cd-378662586be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:50.844756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:50.862376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 486/991] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:51.128334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3314f-fb31-4654-931f-8dc29f26de70 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:51.174009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574302e6-6047-4be9-80e1-8d2b83cadea1 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:51.174323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574302e6-6047-4be9-80e1-8d2b83cadea1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:51.174572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574302e6-6047-4be9-80e1-8d2b83cadea1 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:51.175920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 487/992] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:51.181069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82161c-8617-45dd-83dc-d4d0d9de9b17 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:51.181352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82161c-8617-45dd-83dc-d4d0d9de9b17 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:51.181622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82161c-8617-45dd-83dc-d4d0d9de9b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:51.200537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4d82161c-8617-45dd-83dc-d4d0d9de9b17 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:51.202320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4d82161c-8617-45dd-83dc-d4d0d9de9b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:51.239668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3314f-fb31-4654-931f-8dc29f26de70 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:51.280227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 488/993] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:51.280422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:51.280422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:51.280582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:51.280723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] PATH_INFO: `/v3/services/image` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:51.281331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:51.282714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:51.296419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:51.297433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:51.301155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 506/994] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 31 09:33:51 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:51.303856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82161c-8617-45dd-83dc-d4d0d9de9b17 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:51.404354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d82161c-8617-45dd-83dc-d4d0d9de9b17 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:51.420506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:51.440301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:51.440908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:51.441187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:51.441460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:51.442084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] RBAC: Adding query filter params (name=image) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:51.442385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:51.443744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:51.452536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 489/995] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:51.454901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:51.519844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:51.549357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:51.564278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2f85f-f664-4818-9935-3746987d0808 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:51.598956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:51.599563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:51.599842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:51.600117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:51.600780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] RBAC: Adding query filter params (type=image) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:51.601089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:51.602480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:51.616202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 507/996] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:51 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:51.673583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc463-b23a-4d59-910d-b1b6e091e36d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:51.711808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:51.712537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:51.712823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:51.713093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:51.713686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:51.715076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:51.732453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:51.736415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:51.737363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 490/997] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:51.739858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:51.844735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b093a31d-79ce-4045-9339-259e37e5383f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:51.869953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:51.879750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:51.880387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:51.880733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:51.881014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:51.881644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:51.882009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:51.883436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:51.892389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 508/998] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:51.894755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:51.944763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:52.003468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94400899-42d8-43ce-94d2-f41030dbe62e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:52.038099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0360a21-c96f-4b42-b5b2-a08e71a5633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:52.038712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0360a21-c96f-4b42-b5b2-a08e71a5633b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:52.038992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0360a21-c96f-4b42-b5b2-a08e71a5633b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:52.039266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0360a21-c96f-4b42-b5b2-a08e71a5633b None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:52.039905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0360a21-c96f-4b42-b5b2-a08e71a5633b None admin] RBAC: Adding query filter params (type=compute) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:52.040304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0360a21-c96f-4b42-b5b2-a08e71a5633b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:52.041675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0360a21-c96f-4b42-b5b2-a08e71a5633b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:52.052000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 491/999] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:52.053496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:52.073199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdcdc-1633-4ba7-82c8-1f47be531ee2 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:52.073486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdcdc-1633-4ba7-82c8-1f47be531ee2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:52.073763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fdcdc-1633-4ba7-82c8-1f47be531ee2 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:52.075220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 492/1000] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:52.080628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904645d-e7d0-4f90-8b24-b3bcf3e48d8c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:52.080910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904645d-e7d0-4f90-8b24-b3bcf3e48d8c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:52.081184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904645d-e7d0-4f90-8b24-b3bcf3e48d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:52.099565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e904645d-e7d0-4f90-8b24-b3bcf3e48d8c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:52.100765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e904645d-e7d0-4f90-8b24-b3bcf3e48d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:52.162076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83cbca-8270-46a3-8743-04d3a4a18a74 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:52.170609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 493/1001] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:52.209926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:52.210454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:52.210738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:52.211013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:52.211715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] RBAC: Adding query filter params (interface=public, service_id=efb242eed31c4a2a8712d4955a057ddb, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:52.212022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:52.213439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:52.223832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 509/1002] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 31 09:33:52 2022] GET /identity/v3/endpoints?service_id=efb242eed31c4a2a8712d4955a057ddb&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:52.225050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904645d-e7d0-4f90-8b24-b3bcf3e48d8c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:52.266981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:52.329092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904645d-e7d0-4f90-8b24-b3bcf3e48d8c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:52.362984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d38d-0ba1-46d5-8562-0a967188006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:52.363588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d38d-0ba1-46d5-8562-0a967188006b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:52.363868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d38d-0ba1-46d5-8562-0a967188006b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:52.364139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d38d-0ba1-46d5-8562-0a967188006b None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:52.364771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29d38d-0ba1-46d5-8562-0a967188006b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:52.366128 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29d38d-0ba1-46d5-8562-0a967188006b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:52.372395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 494/1003] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:33:52 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:33:52.439567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:52.501516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:52.553106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd298b05-854d-450a-a1b8-47f994db02d3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:52.587686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:52.588348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:52.588632 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:52.588906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:52.589486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:52.590860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:52.600261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:52.601290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:52.602220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 510/1004] 10.222.0.18 () {56 vars in 1126 bytes} [Wed Aug 31 09:33:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:52.609103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d38d-0ba1-46d5-8562-0a967188006b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:52.717715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d38d-0ba1-46d5-8562-0a967188006b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:52.719351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:52.758315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:52.758842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:52.759117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:52.759396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:52.760022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:52.760364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:52.761722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:52.767191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 495/1005] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:52.772679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:52.880740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ced223-12c6-4e80-855f-5f1dd62d1a17 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:52.898459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:52.916800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88cca7-13f6-488f-8fb4-44f0ef2aa824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:52.917398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88cca7-13f6-488f-8fb4-44f0ef2aa824 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:52.917676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88cca7-13f6-488f-8fb4-44f0ef2aa824 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:52.917947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88cca7-13f6-488f-8fb4-44f0ef2aa824 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:52.918572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88cca7-13f6-488f-8fb4-44f0ef2aa824 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:52.918871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88cca7-13f6-488f-8fb4-44f0ef2aa824 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:52.920901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88cca7-13f6-488f-8fb4-44f0ef2aa824 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:52.925777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 511/1006] 10.222.0.18 () {56 vars in 1122 bytes} [Wed Aug 31 09:33:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:52.931902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:53.034582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a15664-630e-4c1c-9b75-d36c72a28683 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:53.068736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64b872-0e02-4c1f-ba3e-cf3459f759e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:53.069332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b872-0e02-4c1f-ba3e-cf3459f759e8 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:53.069607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b872-0e02-4c1f-ba3e-cf3459f759e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:53.069872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64b872-0e02-4c1f-ba3e-cf3459f759e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:53.070531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64b872-0e02-4c1f-ba3e-cf3459f759e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:53.071876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe64b872-0e02-4c1f-ba3e-cf3459f759e8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:53.089381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 496/1007] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:33:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:53.551173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7bbd-8955-4004-a907-9698ea1b3cae None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:53.551689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7bbd-8955-4004-a907-9698ea1b3cae None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:53.551769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa7bbd-8955-4004-a907-9698ea1b3cae None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:53.553383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 512/1008] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:53.558483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4560-9ecb-4e6b-88c0-40a16fe80081 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:53.558776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4560-9ecb-4e6b-88c0-40a16fe80081 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:53.559051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f4560-9ecb-4e6b-88c0-40a16fe80081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:53.576913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e93f4560-9ecb-4e6b-88c0-40a16fe80081 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:53.578098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e93f4560-9ecb-4e6b-88c0-40a16fe80081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:53.598828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:53.653091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 497/1009] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:53 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:53.924025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7bbd-8955-4004-a907-9698ea1b3cae None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:54.028332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa7bbd-8955-4004-a907-9698ea1b3cae None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:54.064320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee04ce9-0f81-405c-9352-e1014074f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:54.064926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee04ce9-0f81-405c-9352-e1014074f586 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:54.065210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee04ce9-0f81-405c-9352-e1014074f586 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:54.065477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee04ce9-0f81-405c-9352-e1014074f586 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:54.066149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee04ce9-0f81-405c-9352-e1014074f586 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:54.067520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee04ce9-0f81-405c-9352-e1014074f586 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:54.088320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 513/1010] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:33:53 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:54.322496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906b908-078d-4c6c-b1ba-8967df623d00 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:54.322984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906b908-078d-4c6c-b1ba-8967df623d00 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:54.322984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7906b908-078d-4c6c-b1ba-8967df623d00 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:54.324461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 498/1011] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:54.329986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400228a-3d6b-4227-aabe-57942d39c6a4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:54.330274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400228a-3d6b-4227-aabe-57942d39c6a4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:54.330549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400228a-3d6b-4227-aabe-57942d39c6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:54.348823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e400228a-3d6b-4227-aabe-57942d39c6a4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:54.350005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e400228a-3d6b-4227-aabe-57942d39c6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:54.387169 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:54.428839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 514/1012] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:54 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:54.695933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906b908-078d-4c6c-b1ba-8967df623d00 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:54.807236 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7906b908-078d-4c6c-b1ba-8967df623d00 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:54.843218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:54.844152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:54.844627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:54.845071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:54.845816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:54.847350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:54.856188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:54.857796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:54.858656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 499/1013] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:54.864621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400228a-3d6b-4227-aabe-57942d39c6a4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:54.969224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400228a-3d6b-4227-aabe-57942d39c6a4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:55.003059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7c8ee6-9851-4098-a7db-d243dfe2b622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:55.003670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c8ee6-9851-4098-a7db-d243dfe2b622 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:55.003947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c8ee6-9851-4098-a7db-d243dfe2b622 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:55.004242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c8ee6-9851-4098-a7db-d243dfe2b622 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:55.004868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c8ee6-9851-4098-a7db-d243dfe2b622 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:55.005165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c8ee6-9851-4098-a7db-d243dfe2b622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:55.006530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7c8ee6-9851-4098-a7db-d243dfe2b622 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:55.016207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 515/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:55.017385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:55.036291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:55.050036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49c882-a95c-4017-8c5b-1ea2a65cb5dd None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:55.050327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49c882-a95c-4017-8c5b-1ea2a65cb5dd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:55.050601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49c882-a95c-4017-8c5b-1ea2a65cb5dd None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:55.052527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 516/1015] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:55.058376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec50b1-fdc5-4b80-aa72-3a2cdb7d6251 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:55.058661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec50b1-fdc5-4b80-aa72-3a2cdb7d6251 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:55.058938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec50b1-fdc5-4b80-aa72-3a2cdb7d6251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:55.077120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c6ec50b1-fdc5-4b80-aa72-3a2cdb7d6251 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:55.078298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c6ec50b1-fdc5-4b80-aa72-3a2cdb7d6251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:55.106287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:55.127416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563aa48b-c148-4eaf-bc73-72ebd1390432 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:55.154615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 517/1016] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:55 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:55.167099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:55.167978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:55.168451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:55.168908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:55.170531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:55.171052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:55.172672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:55.178650 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 500/1017] 10.222.0.18 () {56 vars in 1112 bytes} [Wed Aug 31 09:33:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:55.184960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec50b1-fdc5-4b80-aa72-3a2cdb7d6251 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:55.288845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec50b1-fdc5-4b80-aa72-3a2cdb7d6251 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:55.322364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2424-80c8-41ad-8519-d25d7d07cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:55.322967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2424-80c8-41ad-8519-d25d7d07cabe None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:55.323248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2424-80c8-41ad-8519-d25d7d07cabe None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:55.323519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2424-80c8-41ad-8519-d25d7d07cabe None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:55.324202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2424-80c8-41ad-8519-d25d7d07cabe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:55.326121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2424-80c8-41ad-8519-d25d7d07cabe None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:55.346380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 518/1018] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:33:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:33:55.430834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:55.523528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:55.545095 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fd810-8636-472e-8bb3-a76743d64ce3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:55.588809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261f365-69ec-4d78-af98-1a7e954752c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:55.589439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261f365-69ec-4d78-af98-1a7e954752c4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:55.589714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261f365-69ec-4d78-af98-1a7e954752c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:55.589982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261f365-69ec-4d78-af98-1a7e954752c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:55.591114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261f365-69ec-4d78-af98-1a7e954752c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:55.593105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8261f365-69ec-4d78-af98-1a7e954752c4 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:55.594990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 501/1019] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:55.600763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2424-80c8-41ad-8519-d25d7d07cabe None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:55.624532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:55.714633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2424-80c8-41ad-8519-d25d7d07cabe None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:55.750768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8dfa5e-8bd9-4276-ab38-3349c5b632d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:55.751380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfa5e-8bd9-4276-ab38-3349c5b632d2 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:55.751658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfa5e-8bd9-4276-ab38-3349c5b632d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:55.751927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8dfa5e-8bd9-4276-ab38-3349c5b632d2 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:55.753173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dfa5e-8bd9-4276-ab38-3349c5b632d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:55.754123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8dfa5e-8bd9-4276-ab38-3349c5b632d2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:55.787594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 519/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:33:55 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:33:56.065494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d935f6-45ae-43eb-9580-54232a4bcefb None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:56.065876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d935f6-45ae-43eb-9580-54232a4bcefb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:56.066076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d935f6-45ae-43eb-9580-54232a4bcefb None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:56.067530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 502/1021] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:56.072550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648cdbf-baea-4e82-912d-b34404a1e8e7 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:56.073015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648cdbf-baea-4e82-912d-b34404a1e8e7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:56.073102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648cdbf-baea-4e82-912d-b34404a1e8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:56.091210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9648cdbf-baea-4e82-912d-b34404a1e8e7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:56.092478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9648cdbf-baea-4e82-912d-b34404a1e8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:56.159020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:56.164768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 520/1022] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:56.439765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d935f6-45ae-43eb-9580-54232a4bcefb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:56.547715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d935f6-45ae-43eb-9580-54232a4bcefb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:56.582071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:56.582694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:56.582975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:56.583248 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] PATH_INFO: `/v3/services/image` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:56.583833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:56.585281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:56.594822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:56.595813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:56.597035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:56.598161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 503/1023] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 31 09:33:56 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:56.601860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648cdbf-baea-4e82-912d-b34404a1e8e7 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:56.708541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648cdbf-baea-4e82-912d-b34404a1e8e7 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:56.748045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:56.748692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:56.748980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:56.749260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:56.749887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] RBAC: Adding query filter params (name=image) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:56.750193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:56.751570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:56.761110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 521/1024] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:56.762260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:56.774070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:56.869531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdeb6-f1c0-45d4-a579-ce88ed5ec3cc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:56.905842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:56.906471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:56.906754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:56.907029 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:56.907687 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] RBAC: Adding query filter params (type=image) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:56.907993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:56.909431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:56.920288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 504/1025] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:56.921672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:56.988546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:57.028492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30251ef6-a140-415a-ac38-c7c94aeb7dda None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:57.062929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac6665-3a0e-46c9-a9b4-2c13a04107d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:57.063540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6665-3a0e-46c9-a9b4-2c13a04107d2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:57.063820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6665-3a0e-46c9-a9b4-2c13a04107d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:57.064091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac6665-3a0e-46c9-a9b4-2c13a04107d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:57.064829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac6665-3a0e-46c9-a9b4-2c13a04107d2 None admin] RBAC: Adding query filter params (interface=public, service_id=b0fe2a5e95c749cab40e112636f02129, region_id=RegionOne) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:57.065140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac6665-3a0e-46c9-a9b4-2c13a04107d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:57.066506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac6665-3a0e-46c9-a9b4-2c13a04107d2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:57.076212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 522/1026] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 31 09:33:56 2022] GET /identity/v3/endpoints?service_id=b0fe2a5e95c749cab40e112636f02129&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:57.077548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:57.151446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:57.184279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff490eb-0816-4d52-aef2-67b22f3e4b21 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:57.221623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471334f-1e37-4755-b862-5be5a057b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:57.222239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471334f-1e37-4755-b862-5be5a057b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:57.222523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471334f-1e37-4755-b862-5be5a057b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:57.222798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471334f-1e37-4755-b862-5be5a057b6f5 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:57.223412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471334f-1e37-4755-b862-5be5a057b6f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:57.224836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471334f-1e37-4755-b862-5be5a057b6f5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:57.237678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 505/1027] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:33:57 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:33:57.377304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6667e-7ed9-44dd-89fe-f75b312e3a5a None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:57.377641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6667e-7ed9-44dd-89fe-f75b312e3a5a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:57.377869 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6667e-7ed9-44dd-89fe-f75b312e3a5a None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:57.379459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 523/1028] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:33:57.388426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc663-fc5e-491d-955a-f35baeea4112 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:57.388426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc663-fc5e-491d-955a-f35baeea4112 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:57.388426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cc663-fc5e-491d-955a-f35baeea4112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:57.408242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-da9cc663-fc5e-491d-955a-f35baeea4112 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:57.409683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-da9cc663-fc5e-491d-955a-f35baeea4112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:57.486963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 506/1029] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:57.765594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6667e-7ed9-44dd-89fe-f75b312e3a5a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:57.768733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a424db-e9ed-4ecb-a29d-20664eebb2d0 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:57.770082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a424db-e9ed-4ecb-a29d-20664eebb2d0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:57.770082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a424db-e9ed-4ecb-a29d-20664eebb2d0 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:57.771151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 507/1030] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:57.775441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18a098-6c84-457c-ab5e-c77814b4b106 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:57.775721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18a098-6c84-457c-ab5e-c77814b4b106 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:57.775996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da18a098-6c84-457c-ab5e-c77814b4b106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:57.794764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-da18a098-6c84-457c-ab5e-c77814b4b106 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:57.796014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-da18a098-6c84-457c-ab5e-c77814b4b106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:57.860249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:57.868447 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 508/1031] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:33:57.882024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6667e-7ed9-44dd-89fe-f75b312e3a5a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:57.910012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:57.918713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e68167-70b7-4c99-99c8-f5f726d30ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:57.920089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e68167-70b7-4c99-99c8-f5f726d30ccb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:57.920417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e68167-70b7-4c99-99c8-f5f726d30ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:57.920708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e68167-70b7-4c99-99c8-f5f726d30ccb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:57.931442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e68167-70b7-4c99-99c8-f5f726d30ccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-10e68167-70b7-4c99-99c8-f5f726d30ccb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:33:57.937131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:57.938077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:33:57.938985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:57.943331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 524/1032] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 31 09:33:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:57.944575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18a098-6c84-457c-ab5e-c77814b4b106 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:58.048656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da18a098-6c84-457c-ab5e-c77814b4b106 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:58.083053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:58.083652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:58.083926 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:58.084213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:58.084873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:58.085170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:58.086516 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:58.099161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 509/1033] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 31 09:33:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:58.100400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e68167-70b7-4c99-99c8-f5f726d30ccb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:58.141001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:58.199991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:58.207457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e68167-70b7-4c99-99c8-f5f726d30ccb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:58.245068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:58.245706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:58.245973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:58.246243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:58.248056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285f2b5-6568-4d55-93d1-6c88e9f2412b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:58.258914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:58.260428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:58.275793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:58.276836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:58.277738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:58.277738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:58.277738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:58.277738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 525/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:58.283027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:58.285777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77187a-3f8a-4554-8e57-5f8ca6c70481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:58.286414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77187a-3f8a-4554-8e57-5f8ca6c70481 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:58.286697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77187a-3f8a-4554-8e57-5f8ca6c70481 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:58.286968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77187a-3f8a-4554-8e57-5f8ca6c70481 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:58.288110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77187a-3f8a-4554-8e57-5f8ca6c70481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:58.289574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77187a-3f8a-4554-8e57-5f8ca6c70481 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:58.291159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 510/1035] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:58.297221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77187a-3f8a-4554-8e57-5f8ca6c70481 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:58.332675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:58.397190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b620-7683-4139-8ca9-408f97faa4bd None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:58.403953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77187a-3f8a-4554-8e57-5f8ca6c70481 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:58.430733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:58.433035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:58.433710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:58.434072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:58.434357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:58.435135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:58.435452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:58.436880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:58.441162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e81f31-74a9-4c3d-ac8b-09d7de8840dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:58.441768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81f31-74a9-4c3d-ac8b-09d7de8840dd None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:58.442049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81f31-74a9-4c3d-ac8b-09d7de8840dd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:58.442318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e81f31-74a9-4c3d-ac8b-09d7de8840dd None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:58.442973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e81f31-74a9-4c3d-ac8b-09d7de8840dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:58.444423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e81f31-74a9-4c3d-ac8b-09d7de8840dd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:58.449316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 526/1036] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:58.455303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:58.470297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 511/1037] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:33:58 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:33:58.569757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:58.573633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba2933-2580-4167-a9ef-03dc42cfe565 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:58.620843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:58.621468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:58.621749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:58.622572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:58.630023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:58.631477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:33:58.644289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:58.645273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:58.646217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 527/1038] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:33:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:58.651139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e81f31-74a9-4c3d-ac8b-09d7de8840dd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:58.763131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e81f31-74a9-4c3d-ac8b-09d7de8840dd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:58.798327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:58.798932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:58.799209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:58.799537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:58.800306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:58.800610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:58.802287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:58.821538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 512/1039] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:33:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:58.827909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:58.928391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243966f-3fed-4c6d-bf6f-ebb44fb7cd27 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:58.962442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d64d9-b367-4399-9d41-99aa9471d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:58.963065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d64d9-b367-4399-9d41-99aa9471d522 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:58.963330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d64d9-b367-4399-9d41-99aa9471d522 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:58.963602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d64d9-b367-4399-9d41-99aa9471d522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:58.995125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:59.036287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d64d9-b367-4399-9d41-99aa9471d522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:59.037753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02d64d9-b367-4399-9d41-99aa9471d522 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:59.141248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 528/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:33:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:33:59.143199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:59.185639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:59.233351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48f173-ca81-4cf6-9329-9deb6cba1371 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.233716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48f173-ca81-4cf6-9329-9deb6cba1371 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.233992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48f173-ca81-4cf6-9329-9deb6cba1371 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.235631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 529/1041] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:33:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:33:59.240578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97f5e-af83-4cf2-8e38-ee2c11444f7b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.241206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97f5e-af83-4cf2-8e38-ee2c11444f7b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.241993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec97f5e-af83-4cf2-8e38-ee2c11444f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.247210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e731b3e-0df5-46f4-9e7e-8dc996f03b6c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:59.264886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-1ec97f5e-af83-4cf2-8e38-ee2c11444f7b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:33:59.266598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1ec97f5e-af83-4cf2-8e38-ee2c11444f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:33:59.283003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:59.283634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.283923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.284198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.294212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:59.295653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:33:59.310495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:59.311445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:33:59.312366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:33:59.312366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:33:59.312366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:59.312366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 513/1042] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:59.317261 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:59.337682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:59.352923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 530/1043] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:33:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:33:59.411426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:59.421583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c094251-eea4-4de6-8529-7e15451f72d2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:59.455818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:59.456373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.456652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.456921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.457562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:59.457860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:59.459205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:59.476083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 514/1044] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:33:59.477416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97f5e-af83-4cf2-8e38-ee2c11444f7b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:59.578885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec97f5e-af83-4cf2-8e38-ee2c11444f7b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:59.614888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:59.615526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.615806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.616080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.625140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:59.626608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:59.628381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:33:59.638668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:59.639650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:33:59.645508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 531/1045] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:33:59.647458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:59.709462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:59.753424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bc181-6232-406d-8aea-0a2e205be81b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:59.766009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995ed3c-48b2-43ab-99d1-17ae1930ed77 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:59.790068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:59.791036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.791546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.791739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] PATH_INFO: `/v3/services/image` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.792355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:59.794322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:59.802637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:59.803235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.803520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.803789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:33:59.804033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:33:59.805114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 09:33:59.805971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:33:59.807175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:59.807175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:59.807175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:59.811006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 515/1046] 10.222.0.18 () {56 vars in 1105 bytes} [Wed Aug 31 09:33:59 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:33:59.811713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:59.827196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 532/1047] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:33:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:59.829229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:59.831098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:59.920326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e526b-0078-4340-894f-3c8bf9e57afd None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:59.939218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b24ec-bf27-476d-bdea-53df43383f8e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:33:59.950380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:33:59.961233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:59.961842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.962126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.962407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.963052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] RBAC: Adding query filter params (name=image) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:59.963359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:59.964768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:59.969844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 516/1048] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:33:59.975524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:33:59.977889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:33:59.978500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:33:59.978786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:33:59.979064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:33:59.979796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] RBAC: Adding query filter params (role.id=e7314870da404a14972513b6a7c9fcbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=0365be92a5d54c8ea32fd003a5619a70) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:33:59.980107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:33:59.982269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:33:59.996205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 533/1049] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:33:59 2022] GET /identity/v3/role_assignments?user.id=0365be92a5d54c8ea32fd003a5619a70&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=e7314870da404a14972513b6a7c9fcbf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:00.069546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:00.092696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7fc10-5d19-4836-9b64-e7292d9c0328 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:00.132668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349a0b2-ea0f-436c-9577-ef713b517add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:00.133278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349a0b2-ea0f-436c-9577-ef713b517add None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:00.133554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349a0b2-ea0f-436c-9577-ef713b517add None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:00.133823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349a0b2-ea0f-436c-9577-ef713b517add None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:00.134462 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349a0b2-ea0f-436c-9577-ef713b517add None admin] RBAC: Adding query filter params (type=image) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:00.134755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349a0b2-ea0f-436c-9577-ef713b517add None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:00.136125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349a0b2-ea0f-436c-9577-ef713b517add None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:00.143187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 517/1050] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:33:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:00.149211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:00.259373 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeb61a-16be-40e7-9fa7-faeaf748aa65 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:00.294384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a247b-46a3-4c04-a44d-fe813268f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:00.294985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a247b-46a3-4c04-a44d-fe813268f042 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:00.295264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a247b-46a3-4c04-a44d-fe813268f042 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:00.295533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a247b-46a3-4c04-a44d-fe813268f042 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:00.296215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a247b-46a3-4c04-a44d-fe813268f042 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:00.297584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a247b-46a3-4c04-a44d-fe813268f042 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:00.324214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 534/1051] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:34:00 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:34:00.458016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a576-ff1d-4a35-9324-7facbddd959e None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:00.458378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a576-ff1d-4a35-9324-7facbddd959e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:00.458573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3a576-ff1d-4a35-9324-7facbddd959e None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:00.460142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 518/1052] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:00.465919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc307c3c-9c3d-42e5-94a4-95595eb81e95 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:00.466253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc307c3c-9c3d-42e5-94a4-95595eb81e95 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:00.466528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc307c3c-9c3d-42e5-94a4-95595eb81e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:00.485691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-dc307c3c-9c3d-42e5-94a4-95595eb81e95 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:00.486887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dc307c3c-9c3d-42e5-94a4-95595eb81e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:00.512354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:00.564164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 535/1053] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:00.833551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3a576-ff1d-4a35-9324-7facbddd959e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:00.941078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3a576-ff1d-4a35-9324-7facbddd959e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:00.976373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de084cb7-2eb3-451a-9766-039741577e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:00.977003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de084cb7-2eb3-451a-9766-039741577e1d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:00.977280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de084cb7-2eb3-451a-9766-039741577e1d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:00.977548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de084cb7-2eb3-451a-9766-039741577e1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:00.988986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de084cb7-2eb3-451a-9766-039741577e1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-de084cb7-2eb3-451a-9766-039741577e1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:00.993848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:00.994763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:00.995648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:34:01.000533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 519/1054] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:01.002966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc307c3c-9c3d-42e5-94a4-95595eb81e95 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:01.103422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc307c3c-9c3d-42e5-94a4-95595eb81e95 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:01.137250 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:01.137856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:01.138133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:01.138405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:01.139085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:01.139392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:01.140800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:01.152327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 536/1055] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:01.155376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de084cb7-2eb3-451a-9766-039741577e1d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:01.159168 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:01.258463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de084cb7-2eb3-451a-9766-039741577e1d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:01.292651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab128b7-bed2-4510-ac91-9d431dc47285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:01.293276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab128b7-bed2-4510-ac91-9d431dc47285 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:01.294102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab128b7-bed2-4510-ac91-9d431dc47285 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:01.294386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab128b7-bed2-4510-ac91-9d431dc47285 None admin] PATH_INFO: `/v3/users/b438671cefba4567bdb615d74cb30d46` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:01.308290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab128b7-bed2-4510-ac91-9d431dc47285 None admin] RBAC: Authorizing `identity:get_user(user_id=b438671cefba4567bdb615d74cb30d46)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:01.310056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab128b7-bed2-4510-ac91-9d431dc47285 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:01.311899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 520/1056] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:01 2022] GET /identity/v3/users/b438671cefba4567bdb615d74cb30d46 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:01.317528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:01.338140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:01.421493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e30d3-6041-4c0c-9be2-837431a71816 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:01.456719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50998857-d818-47bc-8f4d-4e30e70c2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:01.457326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998857-d818-47bc-8f4d-4e30e70c2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:01.457614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998857-d818-47bc-8f4d-4e30e70c2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:01.457890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998857-d818-47bc-8f4d-4e30e70c2cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:01.525151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50998857-d818-47bc-8f4d-4e30e70c2cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:01.526619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50998857-d818-47bc-8f4d-4e30e70c2cd9 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:01.545496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:01.626931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 537/1057] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:34:01.632574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab128b7-bed2-4510-ac91-9d431dc47285 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:01.702100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:01.745197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab128b7-bed2-4510-ac91-9d431dc47285 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:01.779674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705bb5a9-823d-4d70-90a9-b89c95043d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:01.780343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bb5a9-823d-4d70-90a9-b89c95043d8e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:01.780707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bb5a9-823d-4d70-90a9-b89c95043d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:01.780985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705bb5a9-823d-4d70-90a9-b89c95043d8e None admin] PATH_INFO: `/v3/projects/7116f2d3bc3848c8a5eb12513b343826` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:01.782131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bb5a9-823d-4d70-90a9-b89c95043d8e None admin] RBAC: Authorizing `identity:get_project(project_id=7116f2d3bc3848c8a5eb12513b343826)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:01.783557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705bb5a9-823d-4d70-90a9-b89c95043d8e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:01.790299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 521/1058] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:01 2022] GET /identity/v3/projects/7116f2d3bc3848c8a5eb12513b343826 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:01.791260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50998857-d818-47bc-8f4d-4e30e70c2cd9 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:01.898037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50998857-d818-47bc-8f4d-4e30e70c2cd9 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:01.900661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30911-5a2d-42f7-8d7f-e37082fb4bd4 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:01.901140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30911-5a2d-42f7-8d7f-e37082fb4bd4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:01.901241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c30911-5a2d-42f7-8d7f-e37082fb4bd4 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:01.902681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 522/1059] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:34:01.907819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710b61c-2cfd-4c0e-8bf4-be920449613c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:01.908109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710b61c-2cfd-4c0e-8bf4-be920449613c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:01.908420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e710b61c-2cfd-4c0e-8bf4-be920449613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:01.917374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:01.927258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e710b61c-2cfd-4c0e-8bf4-be920449613c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:01.928472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e710b61c-2cfd-4c0e-8bf4-be920449613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:01.937304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037aa0-47d8-444e-8cad-46c7f0a8a40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:01.937983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037aa0-47d8-444e-8cad-46c7f0a8a40f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:01.938279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037aa0-47d8-444e-8cad-46c7f0a8a40f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:01.938557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037aa0-47d8-444e-8cad-46c7f0a8a40f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:01.939282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55037aa0-47d8-444e-8cad-46c7f0a8a40f None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=7116f2d3bc3848c8a5eb12513b343826, user.id=b438671cefba4567bdb615d74cb30d46) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:01.939591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55037aa0-47d8-444e-8cad-46c7f0a8a40f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:01.941081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55037aa0-47d8-444e-8cad-46c7f0a8a40f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:01.956312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 538/1060] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:01 2022] GET /identity/v3/role_assignments?user.id=b438671cefba4567bdb615d74cb30d46&scope.project.id=7116f2d3bc3848c8a5eb12513b343826&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:02.015667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 523/1061] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:34:02.271508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be284428-06d4-47d7-978c-70dae3456c9b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:02.272125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be284428-06d4-47d7-978c-70dae3456c9b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:02.272125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be284428-06d4-47d7-978c-70dae3456c9b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:02.273460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 539/1062] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:02.278649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fdfb-a316-4e2a-87b7-59332a34a7e4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:02.278938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fdfb-a316-4e2a-87b7-59332a34a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:02.279216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4fdfb-a316-4e2a-87b7-59332a34a7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:02.297793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-dba4fdfb-a316-4e2a-87b7-59332a34a7e4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:02.298963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dba4fdfb-a316-4e2a-87b7-59332a34a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:02.311150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be284428-06d4-47d7-978c-70dae3456c9b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:02.364697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:02.377697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 524/1063] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:02.420978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be284428-06d4-47d7-978c-70dae3456c9b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:02.455743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4c223-ed5f-4e7e-b355-b840f71c8fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:02.456394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c223-ed5f-4e7e-b355-b840f71c8fb2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:02.456678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c223-ed5f-4e7e-b355-b840f71c8fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:02.456952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b4c223-ed5f-4e7e-b355-b840f71c8fb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:02.467597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b4c223-ed5f-4e7e-b355-b840f71c8fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-11b4c223-ed5f-4e7e-b355-b840f71c8fb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:02.472563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:02.473518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:02.474371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 540/1064] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 31 09:34:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:02.482251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4fdfb-a316-4e2a-87b7-59332a34a7e4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:02.584632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4fdfb-a316-4e2a-87b7-59332a34a7e4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:02.619564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:02.620483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:02.620963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:02.621509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:02.622484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:02.622994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:02.624640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:02.633129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 525/1065] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 31 09:34:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:02.638878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4c223-ed5f-4e7e-b355-b840f71c8fb2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:02.658914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:02.688658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:02.717297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:02.756281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b4c223-ed5f-4e7e-b355-b840f71c8fb2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:02.772221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c92bab-18b3-49e6-80d4-8e07c55b2d77 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:02.792059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:02.792719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:02.792999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:02.794196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:02.804815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:02.806283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:02.809152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddef2c-e796-46f7-a828-f3dba13aba5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:02.809815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddef2c-e796-46f7-a828-f3dba13aba5a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:02.810099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddef2c-e796-46f7-a828-f3dba13aba5a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:02.810375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdddef2c-e796-46f7-a828-f3dba13aba5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:34:02.821456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:02.822392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:34:02.823280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:34:02.823280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:02.823280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:02.828056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 541/1066] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:34:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:02.829098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:02.883721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdddef2c-e796-46f7-a828-f3dba13aba5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:02.885202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdddef2c-e796-46f7-a828-f3dba13aba5a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:02.935236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:02.943077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a35cf6-faf2-4b1b-be61-d7cc20974c65 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:02.943993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:02.985667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:02.986277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:02.986546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:02.986816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:02.987451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:02.987748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:02.989333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:03.000232 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 526/1067] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 09:34:03.002843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddef2c-e796-46f7-a828-f3dba13aba5a None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:03.008492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 542/1068] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:03.009699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:03.116990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208ed2e-58fb-4311-accc-c48038e9ee46 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:03.119346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdddef2c-e796-46f7-a828-f3dba13aba5a None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:03.152099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:03.153202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.153476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.153759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.155430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:03.156053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.156368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.156646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.161559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:03.162997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:03.167050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:03.168643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:34:03.174275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:03.175198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:03.176468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 543/1069] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:34:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:03.181352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:34:03.186636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:03.187577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:34:03.193583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:34:03.193583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:03.193583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:34:03.193583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 527/1070] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:03.193815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:03.198885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:03.201337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:03.289860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dead18d-bb12-47be-973b-ca36f038be67 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:03.306324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a16376-4dad-4812-b465-6e3ee342c27f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:03.326582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:03.327196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.327477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.327749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.328944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:03.329259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:03.331005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:03.344276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:03.344889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.345171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.345445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.346096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:03.346397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:03.347758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:03.356660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 544/1071] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:34:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:03.359286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:03.372212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 528/1072] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:03.447880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:03.482359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f8fcf-5615-487f-9386-a55ac6f670c2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:03.520205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:03.520851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.521131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.521848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.532692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:03.534159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:34:03.550261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:03.551511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:34:03.552549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:34:03.552549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:03.552549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:03.552549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 545/1073] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:34:03.557496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:03.624666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:03.667492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25098e59-d672-4ddd-bc3d-662117f58e93 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:03.701848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828ca5f-3407-48c4-b878-94b2ace8be8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:03.702367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ca5f-3407-48c4-b878-94b2ace8be8f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.702640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ca5f-3407-48c4-b878-94b2ace8be8f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.702905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ca5f-3407-48c4-b878-94b2ace8be8f None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.703539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ca5f-3407-48c4-b878-94b2ace8be8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:03.703834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ca5f-3407-48c4-b878-94b2ace8be8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:03.705214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ca5f-3407-48c4-b878-94b2ace8be8f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:03.717198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 529/1074] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:03.722849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:03.821432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64213f-d3e1-4ca5-a7d5-21427baa5e61 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:03.845006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:03.856015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:03.856690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.856971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.857243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.863778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:03.865258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:03.874873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f23e-02c5-4f47-9065-e151b667ee79 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.875160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f23e-02c5-4f47-9065-e151b667ee79 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.875438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920f23e-02c5-4f47-9065-e151b667ee79 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:34:03.876727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:03.877604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:03.878495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:34:03.878495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:34:03.878495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:34:03.878495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:34:03.878495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:34:03.878495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:34:03.878495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:34:03.878495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:03.878930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 530/1075] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:34:03.878998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 546/1076] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:34:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:03.881755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4549-585c-45bf-b7f9-abf38896bafa None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:03.882037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4549-585c-45bf-b7f9-abf38896bafa None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:03.882313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b4549-585c-45bf-b7f9-abf38896bafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:03.883360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:03.900991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6c2b4549-585c-45bf-b7f9-abf38896bafa None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:03.902186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6c2b4549-585c-45bf-b7f9-abf38896bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:03.979282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 531/1077] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:34:03.990884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ee5e8-9d12-4ed1-b264-4bfe9839c44f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:04.024341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:04.024943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:04.025284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:04.025570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:04.026264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:04.026574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:04.028852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:04.040539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 547/1078] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:34:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:04.047466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b4549-585c-45bf-b7f9-abf38896bafa None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:04.101241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:04.145207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b4549-585c-45bf-b7f9-abf38896bafa None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:04.179071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00b9fd-021b-476f-bb3e-c015138e8943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:04.179719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00b9fd-021b-476f-bb3e-c015138e8943 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:04.180000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00b9fd-021b-476f-bb3e-c015138e8943 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:04.180307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00b9fd-021b-476f-bb3e-c015138e8943 None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/0365be92a5d54c8ea32fd003a5619a70/roles/e7314870da404a14972513b6a7c9fcbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:04.182468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00b9fd-021b-476f-bb3e-c015138e8943 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=0365be92a5d54c8ea32fd003a5619a70, role_id=e7314870da404a14972513b6a7c9fcbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:04.183931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00b9fd-021b-476f-bb3e-c015138e8943 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:04.196133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 532/1079] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:34:04 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/0365be92a5d54c8ea32fd003a5619a70/roles/e7314870da404a14972513b6a7c9fcbf => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:34:04.251153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:04.301760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:04.361113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110f9fd-69f7-4ded-aabe-0488459ec20d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:04.394738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e47d7-d66b-4ae3-9a13-3d4422c86ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:04.395362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e47d7-d66b-4ae3-9a13-3d4422c86ded None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:04.395644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e47d7-d66b-4ae3-9a13-3d4422c86ded None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:04.395921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e47d7-d66b-4ae3-9a13-3d4422c86ded None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:04.406527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e47d7-d66b-4ae3-9a13-3d4422c86ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-850e47d7-d66b-4ae3-9a13-3d4422c86ded None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:04.411427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:04.412568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:04.413424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 548/1080] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:04.418548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00b9fd-021b-476f-bb3e-c015138e8943 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:04.516545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00b9fd-021b-476f-bb3e-c015138e8943 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:04.531311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:04.552460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:04.553062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:04.553340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:04.553612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:04.554269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:04.554565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:04.555911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:04.563702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 533/1081] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:04.569432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e47d7-d66b-4ae3-9a13-3d4422c86ded None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:04.669618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e47d7-d66b-4ae3-9a13-3d4422c86ded None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:04.671947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:04.705298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ec197-bc79-4e3e-9301-fc57d22dedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:04.705932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec197-bc79-4e3e-9301-fc57d22dedad None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:04.706218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec197-bc79-4e3e-9301-fc57d22dedad None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:04.706496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ec197-bc79-4e3e-9301-fc57d22dedad None admin] PATH_INFO: `/v3/users/b438671cefba4567bdb615d74cb30d46` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:04.707630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ec197-bc79-4e3e-9301-fc57d22dedad None admin] RBAC: Authorizing `identity:get_user(user_id=b438671cefba4567bdb615d74cb30d46)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:04.709118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ec197-bc79-4e3e-9301-fc57d22dedad None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:04.710711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 549/1082] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:04 2022] GET /identity/v3/users/b438671cefba4567bdb615d74cb30d46 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:04.716683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:04.815719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa3746-bfbc-4376-8805-b4c8d5104026 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:04.848711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58821675-3a71-496a-b35c-f33bda597504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:04.849330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821675-3a71-496a-b35c-f33bda597504 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:04.849608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821675-3a71-496a-b35c-f33bda597504 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:04.849878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58821675-3a71-496a-b35c-f33bda597504 None admin] PATH_INFO: `/v3/projects/7116f2d3bc3848c8a5eb12513b343826` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:04.850982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58821675-3a71-496a-b35c-f33bda597504 None admin] RBAC: Authorizing `identity:get_project(project_id=7116f2d3bc3848c8a5eb12513b343826)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:04.852444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58821675-3a71-496a-b35c-f33bda597504 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:04.854079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 534/1083] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:04 2022] GET /identity/v3/projects/7116f2d3bc3848c8a5eb12513b343826 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:04.860135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ec197-bc79-4e3e-9301-fc57d22dedad None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:04.959823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ec197-bc79-4e3e-9301-fc57d22dedad None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:04.992045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162c604-e3c9-4938-a590-4799ab2f5215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:04.992728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c604-e3c9-4938-a590-4799ab2f5215 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:04.992998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c604-e3c9-4938-a590-4799ab2f5215 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:04.993275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162c604-e3c9-4938-a590-4799ab2f5215 None admin] PATH_INFO: `/v3/projects/7116f2d3bc3848c8a5eb12513b343826/users/b438671cefba4567bdb615d74cb30d46/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:04.995184 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162c604-e3c9-4938-a590-4799ab2f5215 None admin] RBAC: Authorizing `identity:create_grant(project_id=7116f2d3bc3848c8a5eb12513b343826, user_id=b438671cefba4567bdb615d74cb30d46, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:04.997280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162c604-e3c9-4938-a590-4799ab2f5215 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:05.009437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 550/1084] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:34:04 2022] PUT /identity/v3/projects/7116f2d3bc3848c8a5eb12513b343826/users/b438671cefba4567bdb615d74cb30d46/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:34:06.103147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c030f9-579a-433a-af86-8a992eda8920 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:06.103680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c030f9-579a-433a-af86-8a992eda8920 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:06.103680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c030f9-579a-433a-af86-8a992eda8920 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:06.105065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 535/1085] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:06.110866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9769a-411c-4eb9-a742-401e2b2e2341 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:06.111292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9769a-411c-4eb9-a742-401e2b2e2341 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:06.111414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c9769a-411c-4eb9-a742-401e2b2e2341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:06.130556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-91c9769a-411c-4eb9-a742-401e2b2e2341 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:06.131744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-91c9769a-411c-4eb9-a742-401e2b2e2341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:06.157468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:06.198527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 551/1086] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:06.475660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c030f9-579a-433a-af86-8a992eda8920 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:06.523263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:06.579998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c030f9-579a-433a-af86-8a992eda8920 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:06.613463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083fcf6-d9c0-42ed-a6f9-45420e6a9d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:06.614078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083fcf6-d9c0-42ed-a6f9-45420e6a9d0c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:06.614355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083fcf6-d9c0-42ed-a6f9-45420e6a9d0c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:06.614623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083fcf6-d9c0-42ed-a6f9-45420e6a9d0c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:06.625002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083fcf6-d9c0-42ed-a6f9-45420e6a9d0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-3083fcf6-d9c0-42ed-a6f9-45420e6a9d0c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:06.629806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:06.630881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:34:06.631748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 536/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Wed Aug 31 09:34:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:06.637532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9769a-411c-4eb9-a742-401e2b2e2341 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:06.735206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c9769a-411c-4eb9-a742-401e2b2e2341 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:06.768664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c3d2f-a5e8-4a41-88c1-d6a521a94789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:06.769266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c3d2f-a5e8-4a41-88c1-d6a521a94789 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:06.769548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c3d2f-a5e8-4a41-88c1-d6a521a94789 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:06.769819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c3d2f-a5e8-4a41-88c1-d6a521a94789 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:06.770474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c3d2f-a5e8-4a41-88c1-d6a521a94789 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:06.770777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c3d2f-a5e8-4a41-88c1-d6a521a94789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:06.772140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c3d2f-a5e8-4a41-88c1-d6a521a94789 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:06.779959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 552/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 31 09:34:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:06.785574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083fcf6-d9c0-42ed-a6f9-45420e6a9d0c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:06.883223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083fcf6-d9c0-42ed-a6f9-45420e6a9d0c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:06.885534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:06.889157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bed6-72f1-4e93-a79b-e2ef8c0fc6c0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:06.889449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bed6-72f1-4e93-a79b-e2ef8c0fc6c0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:06.889731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db6bed6-72f1-4e93-a79b-e2ef8c0fc6c0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:06.891067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 553/1089] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:34:06.896019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6261b74-3d2b-4f12-b788-0017d2adab75 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:06.896332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6261b74-3d2b-4f12-b788-0017d2adab75 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:06.896610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6261b74-3d2b-4f12-b788-0017d2adab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:06.914678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c6261b74-3d2b-4f12-b788-0017d2adab75 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:06.915919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c6261b74-3d2b-4f12-b788-0017d2adab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:06.920278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:06.921022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:06.921405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:06.921677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:06.932465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:06.934483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:06.936345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:34:06.948759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:06.950396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:34:06.951633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:34:06.951633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:06.951633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:34:06.951633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 537/1090] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:06.956306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:06.992366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 554/1091] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:34:07.054438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d276e1-e5f5-4e16-9f9a-95aa074bb29b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.086027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.086613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.086890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.087158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.087788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:07.088084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:07.089459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:07.102225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 538/1092] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:07.108626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6261b74-3d2b-4f12-b788-0017d2adab75 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.205362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6261b74-3d2b-4f12-b788-0017d2adab75 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.237284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.237894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.238172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.238442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.245186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:07.247162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:34:07.258325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:07.264624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 09:34:07.265962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:07.266627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.266716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 555/1093] 10.222.0.18 () {56 vars in 1093 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:34:07.267703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.278111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:07.283772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:07.360222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bda433-9f2d-4581-a5ff-8eacfb7d99a2 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.368577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be546a1-f6a7-42ae-9d58-3d22c890c4a2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.394285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce779-4d3d-49fe-adce-139e60bc2076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.394907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce779-4d3d-49fe-adce-139e60bc2076 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.395184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce779-4d3d-49fe-adce-139e60bc2076 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.395455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce779-4d3d-49fe-adce-139e60bc2076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.402031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.402778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.403065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.403337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.404059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:07.404402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:07.405443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ce779-4d3d-49fe-adce-139e60bc2076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:07.405843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-065ce779-4d3d-49fe-adce-139e60bc2076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:07.410294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:07.411211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:34:07.412061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 539/1094] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:34:07.417290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce779-4d3d-49fe-adce-139e60bc2076 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.424161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 556/1095] 10.222.0.18 () {56 vars in 1133 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:07.430313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.498152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:07.498325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:07.521147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce779-4d3d-49fe-adce-139e60bc2076 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.527598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0c48c-d073-4c0b-9fa5-fc5544d1e0e4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.555243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.555842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.556117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.556412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.557066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:07.557361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:07.559384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:07.562089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ca0b-54ad-4b9f-b8e5-f802a44a4ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.562688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ca0b-54ad-4b9f-b8e5-f802a44a4ed3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.562969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ca0b-54ad-4b9f-b8e5-f802a44a4ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.563247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795ca0b-54ad-4b9f-b8e5-f802a44a4ed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.567458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 540/1096] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:07.573192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.634133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795ca0b-54ad-4b9f-b8e5-f802a44a4ed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:07.635577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795ca0b-54ad-4b9f-b8e5-f802a44a4ed3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:07.678163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044631-3f71-498b-9c40-d34b0fd516de None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.708584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:07.718390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53662d6b-5ca9-4df3-9565-31ca8896930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.719241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662d6b-5ca9-4df3-9565-31ca8896930d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.719516 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662d6b-5ca9-4df3-9565-31ca8896930d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.719780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53662d6b-5ca9-4df3-9565-31ca8896930d None admin] PATH_INFO: `/v3/users/b438671cefba4567bdb615d74cb30d46` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.720976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53662d6b-5ca9-4df3-9565-31ca8896930d None admin] RBAC: Authorizing `identity:get_user(user_id=b438671cefba4567bdb615d74cb30d46)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:07.722404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53662d6b-5ca9-4df3-9565-31ca8896930d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:07.724006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 541/1097] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/users/b438671cefba4567bdb615d74cb30d46 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:07.730298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53662d6b-5ca9-4df3-9565-31ca8896930d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.743510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:07.746814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 557/1098] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 09:34:07.752553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ca0b-54ad-4b9f-b8e5-f802a44a4ed3 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.838757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53662d6b-5ca9-4df3-9565-31ca8896930d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.852787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795ca0b-54ad-4b9f-b8e5-f802a44a4ed3 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:07.880452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0878b-0e10-4278-be1f-ff609e67e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.881091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0878b-0e10-4278-be1f-ff609e67e01c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.882174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0878b-0e10-4278-be1f-ff609e67e01c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.882174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0878b-0e10-4278-be1f-ff609e67e01c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.891736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:07.892386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:07.892676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:07.892953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:07.904740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:07.906259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:34:07.925131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:07.926677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:34:07.927751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:34:07.927751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:34:07.927751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:07.927751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 558/1099] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:34:07.936195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:07.966151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0878b-0e10-4278-be1f-ff609e67e01c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:07.967241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:07.967611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0878b-0e10-4278-be1f-ff609e67e01c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:07.976446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:08.057580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d743c-c86b-4b1c-b8e3-8013cb85c17d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:08.089368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 542/1100] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 09:34:08.096577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0878b-0e10-4278-be1f-ff609e67e01c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:08.098642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:08.099272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:08.099556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:08.099823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:08.100949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:08.101479 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:08.103447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:08.117509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 559/1101] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:08.123460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:08.204783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0878b-0e10-4278-be1f-ff609e67e01c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:08.212319 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:08.227414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:08.245712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1528-f793-415e-981e-eed5a04fd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:08.246746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1528-f793-415e-981e-eed5a04fd693 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:08.247197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1528-f793-415e-981e-eed5a04fd693 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:08.247636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175e1528-f793-415e-981e-eed5a04fd693 None admin] PATH_INFO: `/v3/projects/7116f2d3bc3848c8a5eb12513b343826` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:08.248845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a5eae-b14b-4925-8e84-cc1d7f4cc78e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:08.249444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e1528-f793-415e-981e-eed5a04fd693 None admin] RBAC: Authorizing `identity:get_project(project_id=7116f2d3bc3848c8a5eb12513b343826)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:08.251933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175e1528-f793-415e-981e-eed5a04fd693 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:08.254651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 543/1102] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:08 2022] GET /identity/v3/projects/7116f2d3bc3848c8a5eb12513b343826 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:08.260910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1528-f793-415e-981e-eed5a04fd693 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:08.289171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:08.289803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:08.290084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:08.290358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:08.297572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:08.299040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:34:08.311059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:08.312060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:08.313447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 560/1103] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:34:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:34:08.319152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:08.384649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175e1528-f793-415e-981e-eed5a04fd693 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:08.426455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e71dc-04c2-431f-a542-85b140e4a7b5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:08.426709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:08.427105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:08.427377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:08.427640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:08.428392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=7116f2d3bc3848c8a5eb12513b343826, user.id=b438671cefba4567bdb615d74cb30d46) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:08.428697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:08.430226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:08.437002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 544/1104] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:08 2022] GET /identity/v3/role_assignments?user.id=b438671cefba4567bdb615d74cb30d46&scope.project.id=7116f2d3bc3848c8a5eb12513b343826&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:08.470560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326103-b823-4703-bed4-8b2349b4d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:08.471196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326103-b823-4703-bed4-8b2349b4d668 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:08.471480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326103-b823-4703-bed4-8b2349b4d668 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:08.471767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326103-b823-4703-bed4-8b2349b4d668 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:08.472582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326103-b823-4703-bed4-8b2349b4d668 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:08.472890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326103-b823-4703-bed4-8b2349b4d668 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:08.474393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326103-b823-4703-bed4-8b2349b4d668 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:08.496471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 561/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:34:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:08.497858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:08.542160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:08.607753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140c67a-8134-4db6-9b0e-8cb2513eb9be None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:08.643447 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74cb0-2f75-416e-9f45-57e95ebf3c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:08.644056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74cb0-2f75-416e-9f45-57e95ebf3c40 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:08.644367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74cb0-2f75-416e-9f45-57e95ebf3c40 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:08.644639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74cb0-2f75-416e-9f45-57e95ebf3c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:08.645363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74cb0-2f75-416e-9f45-57e95ebf3c40 None admin] RBAC: Adding query filter params (role.id=e7314870da404a14972513b6a7c9fcbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=0365be92a5d54c8ea32fd003a5619a70) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:08.645668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74cb0-2f75-416e-9f45-57e95ebf3c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:08.647089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74cb0-2f75-416e-9f45-57e95ebf3c40 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:08.653012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 545/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:08 2022] GET /identity/v3/role_assignments?user.id=0365be92a5d54c8ea32fd003a5619a70&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=e7314870da404a14972513b6a7c9fcbf => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:10.415937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547f537-5c81-4db2-90e4-2eae44254f4d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:10.416534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547f537-5c81-4db2-90e4-2eae44254f4d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:10.416534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547f537-5c81-4db2-90e4-2eae44254f4d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:10.418426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 562/1107] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:10.423617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156683d1-cf08-4bdd-8fad-8784ea3395d1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:10.424001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156683d1-cf08-4bdd-8fad-8784ea3395d1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:10.424192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156683d1-cf08-4bdd-8fad-8784ea3395d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:10.442635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-156683d1-cf08-4bdd-8fad-8784ea3395d1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:10.443820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-156683d1-cf08-4bdd-8fad-8784ea3395d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:10.508006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 546/1108] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:10.775595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547f537-5c81-4db2-90e4-2eae44254f4d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:10.780016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:10.876287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547f537-5c81-4db2-90e4-2eae44254f4d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:10.909580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee7d899-9771-4a67-936f-6b78b64dbc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:10.910198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7d899-9771-4a67-936f-6b78b64dbc7f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:10.910476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7d899-9771-4a67-936f-6b78b64dbc7f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:10.910747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee7d899-9771-4a67-936f-6b78b64dbc7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:10.911843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7d899-9771-4a67-936f-6b78b64dbc7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:10.913314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee7d899-9771-4a67-936f-6b78b64dbc7f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:10.914899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 563/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:34:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:10.923120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156683d1-cf08-4bdd-8fad-8784ea3395d1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:10.953026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:11.020454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156683d1-cf08-4bdd-8fad-8784ea3395d1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:11.053939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e3627-5469-4ab8-85e6-9e3fe1e7bc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:11.054535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e3627-5469-4ab8-85e6-9e3fe1e7bc05 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:11.054814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e3627-5469-4ab8-85e6-9e3fe1e7bc05 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:11.055083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e3627-5469-4ab8-85e6-9e3fe1e7bc05 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:11.055727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e3627-5469-4ab8-85e6-9e3fe1e7bc05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:11.057169 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e3627-5469-4ab8-85e6-9e3fe1e7bc05 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:11.078275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 547/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:34:10 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:34:13.031849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e4424-4929-43df-8e8b-b2c1ef24a7d0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:13.032570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e4424-4929-43df-8e8b-b2c1ef24a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:13.032570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e4424-4929-43df-8e8b-b2c1ef24a7d0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:13.033683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 564/1111] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:13.038867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf86a7-4bfc-4f80-84ce-40a1de7c5a87 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:13.039317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf86a7-4bfc-4f80-84ce-40a1de7c5a87 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:13.039421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf86a7-4bfc-4f80-84ce-40a1de7c5a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:13.057495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d4bf86a7-4bfc-4f80-84ce-40a1de7c5a87 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:13.059207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d4bf86a7-4bfc-4f80-84ce-40a1de7c5a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:13.124525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 548/1112] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:13.393356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e4424-4929-43df-8e8b-b2c1ef24a7d0 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:13.463588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:13.493427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e4424-4929-43df-8e8b-b2c1ef24a7d0 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:13.525874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04621d77-8910-4f5c-876d-d7589be18da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:13.527041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621d77-8910-4f5c-876d-d7589be18da1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:13.527337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621d77-8910-4f5c-876d-d7589be18da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:13.527589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04621d77-8910-4f5c-876d-d7589be18da1 None admin] PATH_INFO: `/v3/roles/7f637775fa4c48a194ebb4513effa6b9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:13.529003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04621d77-8910-4f5c-876d-d7589be18da1 None admin] RBAC: Authorizing `identity:get_role(role_id=7f637775fa4c48a194ebb4513effa6b9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:13.530374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04621d77-8910-4f5c-876d-d7589be18da1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:13.531682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 565/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:13 2022] GET /identity/v3/roles/7f637775fa4c48a194ebb4513effa6b9 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:13.537452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf86a7-4bfc-4f80-84ce-40a1de7c5a87 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:13.555604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:13.633159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf86a7-4bfc-4f80-84ce-40a1de7c5a87 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:13.666309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c023f7f-0711-4a82-8099-770761030a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:13.666863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c023f7f-0711-4a82-8099-770761030a83 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:13.667186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c023f7f-0711-4a82-8099-770761030a83 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:13.667458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c023f7f-0711-4a82-8099-770761030a83 None admin] PATH_INFO: `/v3/users/f9a3ae6da9db474c80f6bbb7250d3bd9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:13.680719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c023f7f-0711-4a82-8099-770761030a83 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a3ae6da9db474c80f6bbb7250d3bd9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:13.682146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c023f7f-0711-4a82-8099-770761030a83 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:13.684393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 549/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:13 2022] GET /identity/v3/users/f9a3ae6da9db474c80f6bbb7250d3bd9 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:13.690152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04621d77-8910-4f5c-876d-d7589be18da1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:13.786415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04621d77-8910-4f5c-876d-d7589be18da1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:13.818752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce5dc5-5fda-46b7-a176-f7df954ab609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:13.819345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce5dc5-5fda-46b7-a176-f7df954ab609 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:13.819626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce5dc5-5fda-46b7-a176-f7df954ab609 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:13.819904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce5dc5-5fda-46b7-a176-f7df954ab609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:13.831132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:13.885712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce5dc5-5fda-46b7-a176-f7df954ab609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:13.887329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce5dc5-5fda-46b7-a176-f7df954ab609 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:13.985054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 566/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:34:13.991126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c023f7f-0711-4a82-8099-770761030a83 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:14.067000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:14.090762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c023f7f-0711-4a82-8099-770761030a83 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:14.123231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d801df-1f0a-4c3f-896b-33e4745078c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:14.123844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d801df-1f0a-4c3f-896b-33e4745078c6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:14.124123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d801df-1f0a-4c3f-896b-33e4745078c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:14.124423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d801df-1f0a-4c3f-896b-33e4745078c6 None admin] PATH_INFO: `/v3/projects/7116f2d3bc3848c8a5eb12513b343826` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:14.125533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d801df-1f0a-4c3f-896b-33e4745078c6 None admin] RBAC: Authorizing `identity:get_project(project_id=7116f2d3bc3848c8a5eb12513b343826)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:14.126941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d801df-1f0a-4c3f-896b-33e4745078c6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:14.128590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 550/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:13 2022] GET /identity/v3/projects/7116f2d3bc3848c8a5eb12513b343826 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:14.134662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce5dc5-5fda-46b7-a176-f7df954ab609 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:14.175442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:14.232611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce5dc5-5fda-46b7-a176-f7df954ab609 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:14.268419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d15296-457d-4704-86b3-7a39120e2858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:14.268945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15296-457d-4704-86b3-7a39120e2858 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:14.269223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15296-457d-4704-86b3-7a39120e2858 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:14.269494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d15296-457d-4704-86b3-7a39120e2858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:14.270201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d15296-457d-4704-86b3-7a39120e2858 None admin] RBAC: Adding query filter params (role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=7116f2d3bc3848c8a5eb12513b343826, user.id=f9a3ae6da9db474c80f6bbb7250d3bd9) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:14.270503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d15296-457d-4704-86b3-7a39120e2858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:14.271931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d15296-457d-4704-86b3-7a39120e2858 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:14.277649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 567/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:14 2022] GET /identity/v3/role_assignments?user.id=f9a3ae6da9db474c80f6bbb7250d3bd9&scope.project.id=7116f2d3bc3848c8a5eb12513b343826&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:16.128563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991486d9-0cc1-49da-a27f-50035b897c9c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:16.129089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991486d9-0cc1-49da-a27f-50035b897c9c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:16.129089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991486d9-0cc1-49da-a27f-50035b897c9c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:16.130438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 551/1118] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:16.135637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd67ac8-56e5-4586-bee8-a2f358c50c78 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:16.136011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd67ac8-56e5-4586-bee8-a2f358c50c78 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:16.136245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd67ac8-56e5-4586-bee8-a2f358c50c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:16.154463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ecd67ac8-56e5-4586-bee8-a2f358c50c78 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:16.155638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ecd67ac8-56e5-4586-bee8-a2f358c50c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:16.219329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 568/1119] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:16.494399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991486d9-0cc1-49da-a27f-50035b897c9c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:16.593183 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991486d9-0cc1-49da-a27f-50035b897c9c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:16.625920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e976-7825-4196-94d1-fa647c796620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:16.626527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e976-7825-4196-94d1-fa647c796620 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:16.626801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e976-7825-4196-94d1-fa647c796620 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:16.627067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44e976-7825-4196-94d1-fa647c796620 None admin] PATH_INFO: `/v3/roles/7f637775fa4c48a194ebb4513effa6b9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:16.628447 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44e976-7825-4196-94d1-fa647c796620 None admin] RBAC: Authorizing `identity:get_role(role_id=7f637775fa4c48a194ebb4513effa6b9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:16.629808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c44e976-7825-4196-94d1-fa647c796620 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:16.631099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 552/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:16 2022] GET /identity/v3/roles/7f637775fa4c48a194ebb4513effa6b9 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:16.636925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd67ac8-56e5-4586-bee8-a2f358c50c78 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:16.670197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:16.734829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd67ac8-56e5-4586-bee8-a2f358c50c78 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:16.767124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0dffc-1619-47b1-9209-fa5c178dcc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:16.767684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0dffc-1619-47b1-9209-fa5c178dcc6a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:16.767965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0dffc-1619-47b1-9209-fa5c178dcc6a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:16.768266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b0dffc-1619-47b1-9209-fa5c178dcc6a None admin] PATH_INFO: `/v3/users/f9a3ae6da9db474c80f6bbb7250d3bd9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:16.769380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0dffc-1619-47b1-9209-fa5c178dcc6a None admin] RBAC: Authorizing `identity:get_user(user_id=f9a3ae6da9db474c80f6bbb7250d3bd9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:16.770821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b0dffc-1619-47b1-9209-fa5c178dcc6a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:16.772415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 569/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:16 2022] GET /identity/v3/users/f9a3ae6da9db474c80f6bbb7250d3bd9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:16.778817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e976-7825-4196-94d1-fa647c796620 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:16.794107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:16.876450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44e976-7825-4196-94d1-fa647c796620 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:16.908942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ed8fb-ad75-4da3-b65a-e9357f5a326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:16.909546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed8fb-ad75-4da3-b65a-e9357f5a326c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:16.909824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed8fb-ad75-4da3-b65a-e9357f5a326c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:16.910096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed8fb-ad75-4da3-b65a-e9357f5a326c None admin] PATH_INFO: `/v3/projects/7116f2d3bc3848c8a5eb12513b343826` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:16.911204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ed8fb-ad75-4da3-b65a-e9357f5a326c None admin] RBAC: Authorizing `identity:get_project(project_id=7116f2d3bc3848c8a5eb12513b343826)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:16.912655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ed8fb-ad75-4da3-b65a-e9357f5a326c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:16.914258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 553/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:16 2022] GET /identity/v3/projects/7116f2d3bc3848c8a5eb12513b343826 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:16.920703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0dffc-1619-47b1-9209-fa5c178dcc6a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:17.016731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b0dffc-1619-47b1-9209-fa5c178dcc6a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:17.018293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:17.051142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0c770-9ab2-4715-95ae-fc97ce567153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:17.051779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0c770-9ab2-4715-95ae-fc97ce567153 None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:17.052062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0c770-9ab2-4715-95ae-fc97ce567153 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:17.052371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0c770-9ab2-4715-95ae-fc97ce567153 None admin] PATH_INFO: `/v3/projects/7116f2d3bc3848c8a5eb12513b343826/users/f9a3ae6da9db474c80f6bbb7250d3bd9/roles/7f637775fa4c48a194ebb4513effa6b9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:17.054484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0c770-9ab2-4715-95ae-fc97ce567153 None admin] RBAC: Authorizing `identity:create_grant(project_id=7116f2d3bc3848c8a5eb12513b343826, user_id=f9a3ae6da9db474c80f6bbb7250d3bd9, role_id=7f637775fa4c48a194ebb4513effa6b9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:17.055918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0c770-9ab2-4715-95ae-fc97ce567153 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:17.067796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 570/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:34:16 2022] PUT /identity/v3/projects/7116f2d3bc3848c8a5eb12513b343826/users/f9a3ae6da9db474c80f6bbb7250d3bd9/roles/7f637775fa4c48a194ebb4513effa6b9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:34:18.923249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e6c4c-e783-4c4f-8c07-b3a6f0d99120 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:18.923794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e6c4c-e783-4c4f-8c07-b3a6f0d99120 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:18.923794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e6c4c-e783-4c4f-8c07-b3a6f0d99120 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:18.925414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 554/1124] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:18.930571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a85df-0a82-4d4f-8d2c-e01bd4246bc8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:18.930997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a85df-0a82-4d4f-8d2c-e01bd4246bc8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:18.931134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a85df-0a82-4d4f-8d2c-e01bd4246bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:18.950135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4a2a85df-0a82-4d4f-8d2c-e01bd4246bc8 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:18.951314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4a2a85df-0a82-4d4f-8d2c-e01bd4246bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:19.025232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 571/1125] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:19.295260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e6c4c-e783-4c4f-8c07-b3a6f0d99120 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:19.377147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:19.396591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e6c4c-e783-4c4f-8c07-b3a6f0d99120 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:19.429363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f383cfe-13ba-4970-b96a-a0aec3356315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:19.429988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383cfe-13ba-4970-b96a-a0aec3356315 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:19.430280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383cfe-13ba-4970-b96a-a0aec3356315 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:19.430531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383cfe-13ba-4970-b96a-a0aec3356315 None admin] PATH_INFO: `/v3/roles/7f637775fa4c48a194ebb4513effa6b9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:19.431884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f383cfe-13ba-4970-b96a-a0aec3356315 None admin] RBAC: Authorizing `identity:get_role(role_id=7f637775fa4c48a194ebb4513effa6b9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:19.433989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f383cfe-13ba-4970-b96a-a0aec3356315 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:19.435350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 555/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:19 2022] GET /identity/v3/roles/7f637775fa4c48a194ebb4513effa6b9 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:19.441353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a85df-0a82-4d4f-8d2c-e01bd4246bc8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:19.531423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:19.540736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a85df-0a82-4d4f-8d2c-e01bd4246bc8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:19.574764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ef65e-5c96-4a6b-ae53-3555c94ff720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:19.575321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef65e-5c96-4a6b-ae53-3555c94ff720 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:19.575607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef65e-5c96-4a6b-ae53-3555c94ff720 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:19.575886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ef65e-5c96-4a6b-ae53-3555c94ff720 None admin] PATH_INFO: `/v3/users/f9a3ae6da9db474c80f6bbb7250d3bd9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:19.577042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ef65e-5c96-4a6b-ae53-3555c94ff720 None admin] RBAC: Authorizing `identity:get_user(user_id=f9a3ae6da9db474c80f6bbb7250d3bd9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:19.578497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ef65e-5c96-4a6b-ae53-3555c94ff720 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:19.580072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 572/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:19 2022] GET /identity/v3/users/f9a3ae6da9db474c80f6bbb7250d3bd9 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:19.585826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f383cfe-13ba-4970-b96a-a0aec3356315 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:19.686315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f383cfe-13ba-4970-b96a-a0aec3356315 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:19.720030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7323699-7491-432a-9d7f-af4deb11bd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:19.720679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323699-7491-432a-9d7f-af4deb11bd28 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:19.720968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323699-7491-432a-9d7f-af4deb11bd28 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:19.721244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7323699-7491-432a-9d7f-af4deb11bd28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:19.739423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:19.789511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7323699-7491-432a-9d7f-af4deb11bd28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:19.790953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7323699-7491-432a-9d7f-af4deb11bd28 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:19.888771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 556/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:34:19.894650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ef65e-5c96-4a6b-ae53-3555c94ff720 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:19.994057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ef65e-5c96-4a6b-ae53-3555c94ff720 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:20.027068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc680b-3e28-406a-9498-e44f733a6e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:20.027673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc680b-3e28-406a-9498-e44f733a6e2a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:20.027953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc680b-3e28-406a-9498-e44f733a6e2a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:20.028253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc680b-3e28-406a-9498-e44f733a6e2a None admin] PATH_INFO: `/v3/projects/7116f2d3bc3848c8a5eb12513b343826` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:20.029356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc680b-3e28-406a-9498-e44f733a6e2a None admin] RBAC: Authorizing `identity:get_project(project_id=7116f2d3bc3848c8a5eb12513b343826)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:20.030786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc680b-3e28-406a-9498-e44f733a6e2a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:20.032449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 573/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:19 2022] GET /identity/v3/projects/7116f2d3bc3848c8a5eb12513b343826 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:20.038511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7323699-7491-432a-9d7f-af4deb11bd28 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:20.085998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:20.136300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7323699-7491-432a-9d7f-af4deb11bd28 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:20.169635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d698f38-8921-47a6-87b9-79c64e347b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:20.170169 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698f38-8921-47a6-87b9-79c64e347b81 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:20.170449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698f38-8921-47a6-87b9-79c64e347b81 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:20.170721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d698f38-8921-47a6-87b9-79c64e347b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:20.171435 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d698f38-8921-47a6-87b9-79c64e347b81 None admin] RBAC: Adding query filter params (role.id=7f637775fa4c48a194ebb4513effa6b9, scope.project.id=7116f2d3bc3848c8a5eb12513b343826, user.id=f9a3ae6da9db474c80f6bbb7250d3bd9) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:20.171742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d698f38-8921-47a6-87b9-79c64e347b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:20.173186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d698f38-8921-47a6-87b9-79c64e347b81 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:20.178996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 557/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:20 2022] GET /identity/v3/role_assignments?user.id=f9a3ae6da9db474c80f6bbb7250d3bd9&scope.project.id=7116f2d3bc3848c8a5eb12513b343826&role.id=7f637775fa4c48a194ebb4513effa6b9 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:22.071221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db1110-6ee9-4b05-9689-3af4077c6f73 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:22.071718 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db1110-6ee9-4b05-9689-3af4077c6f73 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:22.071718 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db1110-6ee9-4b05-9689-3af4077c6f73 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:22.073668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 574/1131] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:22.078880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c7cd5-2b9b-46df-aac5-b6395a025fe9 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:22.079292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c7cd5-2b9b-46df-aac5-b6395a025fe9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:22.079431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c7cd5-2b9b-46df-aac5-b6395a025fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:22.097091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e48c7cd5-2b9b-46df-aac5-b6395a025fe9 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:22.098263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e48c7cd5-2b9b-46df-aac5-b6395a025fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:22.162617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 558/1132] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:22.433329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db1110-6ee9-4b05-9689-3af4077c6f73 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:22.461328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:22.533228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db1110-6ee9-4b05-9689-3af4077c6f73 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:22.566716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae02382-a61a-456f-af85-8259b2a1e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:22.567328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae02382-a61a-456f-af85-8259b2a1e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:22.567610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae02382-a61a-456f-af85-8259b2a1e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:22.567885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae02382-a61a-456f-af85-8259b2a1e3a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:22.569080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae02382-a61a-456f-af85-8259b2a1e3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:22.570532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae02382-a61a-456f-af85-8259b2a1e3a2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:22.572089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 575/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:34:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:22.577955 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c7cd5-2b9b-46df-aac5-b6395a025fe9 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:22.620157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:22.675340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c7cd5-2b9b-46df-aac5-b6395a025fe9 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:22.708043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62222022-27ba-4f42-990b-910c85bdebe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:22.708611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222022-27ba-4f42-990b-910c85bdebe6 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:22.708890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222022-27ba-4f42-990b-910c85bdebe6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:22.709159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222022-27ba-4f42-990b-910c85bdebe6 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:22.709801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62222022-27ba-4f42-990b-910c85bdebe6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:22.711211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62222022-27ba-4f42-990b-910c85bdebe6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:22.738677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 559/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:34:22 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:34:24.689093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6291d-129d-4db8-828d-ab451d62d33b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:24.689644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6291d-129d-4db8-828d-ab451d62d33b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:24.689644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6291d-129d-4db8-828d-ab451d62d33b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:24.690978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 576/1135] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:24.696279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fb6f5-3a3c-41af-919b-703052b87af1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:24.696680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fb6f5-3a3c-41af-919b-703052b87af1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:24.696836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fb6f5-3a3c-41af-919b-703052b87af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:24.714764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-fd7fb6f5-3a3c-41af-919b-703052b87af1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:24.715930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fd7fb6f5-3a3c-41af-919b-703052b87af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:24.781010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 560/1136] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:25.057952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6291d-129d-4db8-828d-ab451d62d33b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:25.148324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:25.155769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6291d-129d-4db8-828d-ab451d62d33b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:25.188537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa99b7-d125-4958-8688-4c384edc2ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:25.189145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa99b7-d125-4958-8688-4c384edc2ba2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:25.189428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa99b7-d125-4958-8688-4c384edc2ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:25.189697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa99b7-d125-4958-8688-4c384edc2ba2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:25.190817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa99b7-d125-4958-8688-4c384edc2ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:25.192270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa99b7-d125-4958-8688-4c384edc2ba2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:25.193817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 577/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:34:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:25.199537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fb6f5-3a3c-41af-919b-703052b87af1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:25.223643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:25.301126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fb6f5-3a3c-41af-919b-703052b87af1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:25.333771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab79007-8aba-42f3-8d97-27211f840b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:25.334299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab79007-8aba-42f3-8d97-27211f840b7d None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:25.334577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab79007-8aba-42f3-8d97-27211f840b7d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:25.334844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab79007-8aba-42f3-8d97-27211f840b7d None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:25.335480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab79007-8aba-42f3-8d97-27211f840b7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:25.337011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab79007-8aba-42f3-8d97-27211f840b7d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:25.357834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 561/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:34:25 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:34:27.282577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885907b-87ee-4108-9634-255c7c4da5b1 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:27.283133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885907b-87ee-4108-9634-255c7c4da5b1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:27.283133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885907b-87ee-4108-9634-255c7c4da5b1 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:27.284625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 578/1139] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:27.289790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6ede-013c-4168-b1f6-4340d580f77d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:27.290224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6ede-013c-4168-b1f6-4340d580f77d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:27.290323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c6ede-013c-4168-b1f6-4340d580f77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:27.308945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d18c6ede-013c-4168-b1f6-4340d580f77d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:27.310113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d18c6ede-013c-4168-b1f6-4340d580f77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:27.375335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 562/1140] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:27.641428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885907b-87ee-4108-9634-255c7c4da5b1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:27.740071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885907b-87ee-4108-9634-255c7c4da5b1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:27.772975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656301bd-9380-482f-bc44-b0c74969f3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:27.773590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656301bd-9380-482f-bc44-b0c74969f3c7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:27.773873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656301bd-9380-482f-bc44-b0c74969f3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:27.774147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656301bd-9380-482f-bc44-b0c74969f3c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:27.783926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656301bd-9380-482f-bc44-b0c74969f3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-656301bd-9380-482f-bc44-b0c74969f3c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:27.788744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:27.789877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:27.791742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 579/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:27.796839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c6ede-013c-4168-b1f6-4340d580f77d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:27.809204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:27.893574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c6ede-013c-4168-b1f6-4340d580f77d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:27.927126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:27.927721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:27.928003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:27.928305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:27.928967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:27.929268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:27.930664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:27.938484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 563/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:27.944298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656301bd-9380-482f-bc44-b0c74969f3c7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:27.972009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:28.046108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656301bd-9380-482f-bc44-b0c74969f3c7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:28.078524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feff4d-c861-4749-bc76-8a16b29d259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:28.079138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feff4d-c861-4749-bc76-8a16b29d259d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:28.079418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feff4d-c861-4749-bc76-8a16b29d259d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:28.079693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feff4d-c861-4749-bc76-8a16b29d259d None admin] PATH_INFO: `/v3/users/40a0f9c233d24ce7a6e093b9640d7882` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:28.092856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feff4d-c861-4749-bc76-8a16b29d259d None admin] RBAC: Authorizing `identity:get_user(user_id=40a0f9c233d24ce7a6e093b9640d7882)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:28.094296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2feff4d-c861-4749-bc76-8a16b29d259d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:28.095885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 580/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:27 2022] GET /identity/v3/users/40a0f9c233d24ce7a6e093b9640d7882 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:28.101874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:28.170021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:28.199672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b2c489-8bc3-4719-b0e2-e02a79aede8d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:28.232867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441ad7-db59-439f-a382-826ece794fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:28.233458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441ad7-db59-439f-a382-826ece794fe5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:28.233737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441ad7-db59-439f-a382-826ece794fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:28.234004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb441ad7-db59-439f-a382-826ece794fe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:28.299119 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb441ad7-db59-439f-a382-826ece794fe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:28.300588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb441ad7-db59-439f-a382-826ece794fe5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:28.365715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:28.397141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 564/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:34:28.403754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feff4d-c861-4749-bc76-8a16b29d259d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:28.484913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:28.503543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feff4d-c861-4749-bc76-8a16b29d259d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:28.535945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c9275-5120-46d1-adff-5afe91bae34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:28.536582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9275-5120-46d1-adff-5afe91bae34d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:28.536863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9275-5120-46d1-adff-5afe91bae34d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:28.537133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c9275-5120-46d1-adff-5afe91bae34d None admin] PATH_INFO: `/v3/projects/c4103f404db64595bf73b49959ad8ef2` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:28.538229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9275-5120-46d1-adff-5afe91bae34d None admin] RBAC: Authorizing `identity:get_project(project_id=c4103f404db64595bf73b49959ad8ef2)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:28.539719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c9275-5120-46d1-adff-5afe91bae34d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:28.542017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 581/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:28 2022] GET /identity/v3/projects/c4103f404db64595bf73b49959ad8ef2 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:28.548222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441ad7-db59-439f-a382-826ece794fe5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:28.644374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb441ad7-db59-439f-a382-826ece794fe5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:28.677224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eb7aa-9df5-46a3-a043-bdc9084764d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:28.677820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb7aa-9df5-46a3-a043-bdc9084764d3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:28.678100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb7aa-9df5-46a3-a043-bdc9084764d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:28.678373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb7aa-9df5-46a3-a043-bdc9084764d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:28.679090 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eb7aa-9df5-46a3-a043-bdc9084764d3 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=c4103f404db64595bf73b49959ad8ef2, user.id=40a0f9c233d24ce7a6e093b9640d7882) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:28.679398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eb7aa-9df5-46a3-a043-bdc9084764d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:28.680863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eb7aa-9df5-46a3-a043-bdc9084764d3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:28.686866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 565/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:28 2022] GET /identity/v3/role_assignments?user.id=40a0f9c233d24ce7a6e093b9640d7882&scope.project.id=c4103f404db64595bf73b49959ad8ef2&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:30.536095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd1b3-e789-40b3-9502-9ab2201c1ae5 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:30.536647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd1b3-e789-40b3-9502-9ab2201c1ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:30.536761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bd1b3-e789-40b3-9502-9ab2201c1ae5 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:30.538013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 582/1147] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:30.543827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce598-ee00-4900-945a-e405fe1ff1f6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:30.544240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce598-ee00-4900-945a-e405fe1ff1f6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:30.544403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce598-ee00-4900-945a-e405fe1ff1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:30.563080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-323ce598-ee00-4900-945a-e405fe1ff1f6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:30.564282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-323ce598-ee00-4900-945a-e405fe1ff1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:30.591972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:30.629793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 566/1148] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:30.898308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bd1b3-e789-40b3-9502-9ab2201c1ae5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:30.997878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bd1b3-e789-40b3-9502-9ab2201c1ae5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:31.030246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f0576-1cf7-4bc9-bcd8-3828c173d02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:31.030853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0576-1cf7-4bc9-bcd8-3828c173d02b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:31.031131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0576-1cf7-4bc9-bcd8-3828c173d02b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:31.031399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f0576-1cf7-4bc9-bcd8-3828c173d02b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:31.041041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f0576-1cf7-4bc9-bcd8-3828c173d02b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-c49f0576-1cf7-4bc9-bcd8-3828c173d02b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:31.045816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:31.046887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:31.047749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 583/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:31.053151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ce598-ee00-4900-945a-e405fe1ff1f6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:31.148909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ce598-ee00-4900-945a-e405fe1ff1f6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:31.181048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:31.182229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:31.182520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:31.182793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:31.183450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:31.183750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:31.185343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:31.192967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 567/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:31.198926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f0576-1cf7-4bc9-bcd8-3828c173d02b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:31.211481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:31.297916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f0576-1cf7-4bc9-bcd8-3828c173d02b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:31.331266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628088-429a-4a3b-9806-948a558318cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:31.331881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628088-429a-4a3b-9806-948a558318cf None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:31.332163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628088-429a-4a3b-9806-948a558318cf None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:31.332468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42628088-429a-4a3b-9806-948a558318cf None admin] PATH_INFO: `/v3/users/40a0f9c233d24ce7a6e093b9640d7882` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:31.333586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42628088-429a-4a3b-9806-948a558318cf None admin] RBAC: Authorizing `identity:get_user(user_id=40a0f9c233d24ce7a6e093b9640d7882)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:31.335033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42628088-429a-4a3b-9806-948a558318cf None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:31.336628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 584/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:31 2022] GET /identity/v3/users/40a0f9c233d24ce7a6e093b9640d7882 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:31.342565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:31.371380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:31.441446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba158ce2-23a4-4929-91d1-a346456b03c5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:31.475218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd925d-9e5e-45d8-a6db-bc32d3557f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:31.475839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd925d-9e5e-45d8-a6db-bc32d3557f09 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:31.476115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd925d-9e5e-45d8-a6db-bc32d3557f09 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:31.476418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd925d-9e5e-45d8-a6db-bc32d3557f09 None admin] PATH_INFO: `/v3/projects/c4103f404db64595bf73b49959ad8ef2` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:31.477519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd925d-9e5e-45d8-a6db-bc32d3557f09 None admin] RBAC: Authorizing `identity:get_project(project_id=c4103f404db64595bf73b49959ad8ef2)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:31.479824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd925d-9e5e-45d8-a6db-bc32d3557f09 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:31.481809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 568/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:31 2022] GET /identity/v3/projects/c4103f404db64595bf73b49959ad8ef2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:31.487778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628088-429a-4a3b-9806-948a558318cf None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:31.564380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:31.584909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42628088-429a-4a3b-9806-948a558318cf None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:31.616883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753a795-d4b4-4c6f-893c-27a45812bd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:31.617511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a795-d4b4-4c6f-893c-27a45812bd1d None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:31.617788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a795-d4b4-4c6f-893c-27a45812bd1d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:31.618054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753a795-d4b4-4c6f-893c-27a45812bd1d None admin] PATH_INFO: `/v3/projects/c4103f404db64595bf73b49959ad8ef2/users/40a0f9c233d24ce7a6e093b9640d7882/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:31.620071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753a795-d4b4-4c6f-893c-27a45812bd1d None admin] RBAC: Authorizing `identity:create_grant(project_id=c4103f404db64595bf73b49959ad8ef2, user_id=40a0f9c233d24ce7a6e093b9640d7882, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:31.621521 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753a795-d4b4-4c6f-893c-27a45812bd1d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:31.635292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 585/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:34:31 2022] PUT /identity/v3/projects/c4103f404db64595bf73b49959ad8ef2/users/40a0f9c233d24ce7a6e093b9640d7882/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:34:33.658262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc60be-0cc2-46ba-801f-c8f44a562bdc None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:33.658834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc60be-0cc2-46ba-801f-c8f44a562bdc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:33.658834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc60be-0cc2-46ba-801f-c8f44a562bdc None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:33.660139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 569/1154] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:33.665452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179f542-29d0-4bf8-81ae-a41e9f1801d8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:33.665885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179f542-29d0-4bf8-81ae-a41e9f1801d8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:33.666000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179f542-29d0-4bf8-81ae-a41e9f1801d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:33.684139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4179f542-29d0-4bf8-81ae-a41e9f1801d8 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:33.685372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4179f542-29d0-4bf8-81ae-a41e9f1801d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:33.753912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 586/1155] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:34.027788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc60be-0cc2-46ba-801f-c8f44a562bdc None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:34.121937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:34.128879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc60be-0cc2-46ba-801f-c8f44a562bdc None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:34.161906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190828ac-6ddf-4b61-8d5a-69cfc17583c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:34.162534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190828ac-6ddf-4b61-8d5a-69cfc17583c4 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:34.162814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190828ac-6ddf-4b61-8d5a-69cfc17583c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:34.163082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190828ac-6ddf-4b61-8d5a-69cfc17583c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:34.174030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190828ac-6ddf-4b61-8d5a-69cfc17583c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-190828ac-6ddf-4b61-8d5a-69cfc17583c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:34.178919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:34.180015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:34:34.181663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 570/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:34.186879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179f542-29d0-4bf8-81ae-a41e9f1801d8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:34.250769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:34.285030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179f542-29d0-4bf8-81ae-a41e9f1801d8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:34.319590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:34.320216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:34.320503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:34.320779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:34.321441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:34.321827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:34.323406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:34.331428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 587/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:34.337272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190828ac-6ddf-4b61-8d5a-69cfc17583c4 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:34.442533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190828ac-6ddf-4b61-8d5a-69cfc17583c4 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:34.474683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6901d3b-f8b4-438b-a738-d647e6e698df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:34.475299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901d3b-f8b4-438b-a738-d647e6e698df None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:34.475577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901d3b-f8b4-438b-a738-d647e6e698df None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:34.475849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6901d3b-f8b4-438b-a738-d647e6e698df None admin] PATH_INFO: `/v3/users/40a0f9c233d24ce7a6e093b9640d7882` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:34.476987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6901d3b-f8b4-438b-a738-d647e6e698df None admin] RBAC: Authorizing `identity:get_user(user_id=40a0f9c233d24ce7a6e093b9640d7882)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:34.478985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6901d3b-f8b4-438b-a738-d647e6e698df None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:34.480598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 571/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:34 2022] GET /identity/v3/users/40a0f9c233d24ce7a6e093b9640d7882 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:34.486537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:34.585180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274a85e-6226-48cc-aa0b-d644e1a5bc4a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:34.611979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:34.618258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc2398-1d19-4074-b05b-01c4f44de3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:34.619464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc2398-1d19-4074-b05b-01c4f44de3ec None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:34.619742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc2398-1d19-4074-b05b-01c4f44de3ec None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:34.620011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc2398-1d19-4074-b05b-01c4f44de3ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:34.685081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc2398-1d19-4074-b05b-01c4f44de3ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:34.686530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc2398-1d19-4074-b05b-01c4f44de3ec None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:34.786282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 588/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:34:34.792898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6901d3b-f8b4-438b-a738-d647e6e698df None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:34.818101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:34.890286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6901d3b-f8b4-438b-a738-d647e6e698df None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:34.922857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63194c1-6e68-4d89-866b-57b13c6f0c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:34.923723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63194c1-6e68-4d89-866b-57b13c6f0c78 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:34.924000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63194c1-6e68-4d89-866b-57b13c6f0c78 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:34.924308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63194c1-6e68-4d89-866b-57b13c6f0c78 None admin] PATH_INFO: `/v3/projects/c4103f404db64595bf73b49959ad8ef2` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:34.925443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63194c1-6e68-4d89-866b-57b13c6f0c78 None admin] RBAC: Authorizing `identity:get_project(project_id=c4103f404db64595bf73b49959ad8ef2)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:34.926858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63194c1-6e68-4d89-866b-57b13c6f0c78 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:34.928537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 572/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:34 2022] GET /identity/v3/projects/c4103f404db64595bf73b49959ad8ef2 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:34.935414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc2398-1d19-4074-b05b-01c4f44de3ec None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:34.964987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:35.038614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc2398-1d19-4074-b05b-01c4f44de3ec None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:35.072584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18f09a-d5b4-4354-b9c6-e6dd59785b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:35.073165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f09a-d5b4-4354-b9c6-e6dd59785b78 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:35.073451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f09a-d5b4-4354-b9c6-e6dd59785b78 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:35.073719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18f09a-d5b4-4354-b9c6-e6dd59785b78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:35.074427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18f09a-d5b4-4354-b9c6-e6dd59785b78 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=c4103f404db64595bf73b49959ad8ef2, user.id=40a0f9c233d24ce7a6e093b9640d7882) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:35.074731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18f09a-d5b4-4354-b9c6-e6dd59785b78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:35.076154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18f09a-d5b4-4354-b9c6-e6dd59785b78 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:35.081746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 589/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:34 2022] GET /identity/v3/role_assignments?user.id=40a0f9c233d24ce7a6e093b9640d7882&scope.project.id=c4103f404db64595bf73b49959ad8ef2&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:37.010043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1851d2-82ce-4e30-9eb0-5ef67045deda None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:37.010540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1851d2-82ce-4e30-9eb0-5ef67045deda None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:37.010540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1851d2-82ce-4e30-9eb0-5ef67045deda None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:37.011819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 573/1162] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:37.017173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135976d9-7e02-44ec-878f-8a02345b5420 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:37.017560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135976d9-7e02-44ec-878f-8a02345b5420 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:37.017727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135976d9-7e02-44ec-878f-8a02345b5420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:37.035955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-135976d9-7e02-44ec-878f-8a02345b5420 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:37.037172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-135976d9-7e02-44ec-878f-8a02345b5420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:37.101044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 590/1163] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:37.369851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1851d2-82ce-4e30-9eb0-5ef67045deda None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:37.461629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:37.472199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1851d2-82ce-4e30-9eb0-5ef67045deda None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:37.504296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e5a4f-3ed7-49fd-86c3-97b97069b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:37.504888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e5a4f-3ed7-49fd-86c3-97b97069b93f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:37.505164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e5a4f-3ed7-49fd-86c3-97b97069b93f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:37.505431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e5a4f-3ed7-49fd-86c3-97b97069b93f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:37.571118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e5a4f-3ed7-49fd-86c3-97b97069b93f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:37.573238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e5a4f-3ed7-49fd-86c3-97b97069b93f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:37.658944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:37.669052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 574/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:34:37.675152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135976d9-7e02-44ec-878f-8a02345b5420 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:37.699706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:37.772158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135976d9-7e02-44ec-878f-8a02345b5420 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:37.805466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580a1b2-119b-4250-8b0a-bd26a71636eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:37.806590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a1b2-119b-4250-8b0a-bd26a71636eb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:37.806925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a1b2-119b-4250-8b0a-bd26a71636eb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:37.807134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a1b2-119b-4250-8b0a-bd26a71636eb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:37.813531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580a1b2-119b-4250-8b0a-bd26a71636eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:37.814977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2580a1b2-119b-4250-8b0a-bd26a71636eb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2580a1b2-119b-4250-8b0a-bd26a71636eb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:37.826563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:37.827852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:37.828936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 591/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:34:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:37.833561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e5a4f-3ed7-49fd-86c3-97b97069b93f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:37.929450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e5a4f-3ed7-49fd-86c3-97b97069b93f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:37.961378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8497a-5cb5-4daa-b9e0-4dafe55317ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:37.961967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8497a-5cb5-4daa-b9e0-4dafe55317ba None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:37.962809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8497a-5cb5-4daa-b9e0-4dafe55317ba None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:37.963073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8497a-5cb5-4daa-b9e0-4dafe55317ba None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:37.963739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8497a-5cb5-4daa-b9e0-4dafe55317ba None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:37.964037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8497a-5cb5-4daa-b9e0-4dafe55317ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:37.965426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8497a-5cb5-4daa-b9e0-4dafe55317ba None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:37.972303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 575/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Wed Aug 31 09:34:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:39.829353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01f911-6754-499c-a1e4-8bd3ea101349 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:39.829895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01f911-6754-499c-a1e4-8bd3ea101349 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:39.829895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01f911-6754-499c-a1e4-8bd3ea101349 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:39.831240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 592/1167] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:39.836354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcccc-dc00-4015-9468-95a7f6203752 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:39.836770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcccc-dc00-4015-9468-95a7f6203752 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:39.836922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4bcccc-dc00-4015-9468-95a7f6203752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:39.855367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8c4bcccc-dc00-4015-9468-95a7f6203752 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:39.856588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8c4bcccc-dc00-4015-9468-95a7f6203752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:39.905994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:39.923778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 576/1168] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:40.192247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01f911-6754-499c-a1e4-8bd3ea101349 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:40.275433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:40.292145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01f911-6754-499c-a1e4-8bd3ea101349 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:40.325048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29046413-3f54-4382-a4bd-a52debfaa648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:40.325639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046413-3f54-4382-a4bd-a52debfaa648 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:40.325924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046413-3f54-4382-a4bd-a52debfaa648 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:40.326198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29046413-3f54-4382-a4bd-a52debfaa648 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:40.326860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29046413-3f54-4382-a4bd-a52debfaa648 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:40.328313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29046413-3f54-4382-a4bd-a52debfaa648 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:40.346694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 593/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Wed Aug 31 09:34:40 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:34:42.281605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd25f-a6af-49c7-ab46-bb04dfb90573 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:42.282233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd25f-a6af-49c7-ab46-bb04dfb90573 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:42.282233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd25f-a6af-49c7-ab46-bb04dfb90573 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:42.283540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 577/1170] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:42.288860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461024c0-4250-41bb-97e2-51635dc1b3dd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:42.289350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461024c0-4250-41bb-97e2-51635dc1b3dd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:42.289833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461024c0-4250-41bb-97e2-51635dc1b3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:42.311561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-461024c0-4250-41bb-97e2-51635dc1b3dd None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:42.313097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-461024c0-4250-41bb-97e2-51635dc1b3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:42.378271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 594/1171] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:42.651710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abd25f-a6af-49c7-ab46-bb04dfb90573 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:42.753166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abd25f-a6af-49c7-ab46-bb04dfb90573 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:42.785119 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94367c5-9560-42e5-910a-f392ab788aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:42.785760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94367c5-9560-42e5-910a-f392ab788aee None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:42.786037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94367c5-9560-42e5-910a-f392ab788aee None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:42.786305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94367c5-9560-42e5-910a-f392ab788aee None admin] PATH_INFO: `/v3/domains/5b1c272bd7b0432daaa02da18f148bd3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:42.796902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94367c5-9560-42e5-910a-f392ab788aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=5b1c272bd7b0432daaa02da18f148bd3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:42.798593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94367c5-9560-42e5-910a-f392ab788aee None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:42.800162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 578/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Aug 31 09:34:42 2022] GET /identity/v3/domains/5b1c272bd7b0432daaa02da18f148bd3 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:34:42.806631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461024c0-4250-41bb-97e2-51635dc1b3dd None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:42.877905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:42.903617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461024c0-4250-41bb-97e2-51635dc1b3dd None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:42.937323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088fbdd-8ed2-44aa-a0f2-77eeeadc8a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:42.937915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088fbdd-8ed2-44aa-a0f2-77eeeadc8a14 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:42.938196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088fbdd-8ed2-44aa-a0f2-77eeeadc8a14 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:42.938470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088fbdd-8ed2-44aa-a0f2-77eeeadc8a14 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:42.939112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088fbdd-8ed2-44aa-a0f2-77eeeadc8a14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:42.940568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088fbdd-8ed2-44aa-a0f2-77eeeadc8a14 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:42.966042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 595/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:34:42 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:34:44.870229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3cf8-292d-4548-8d63-5b718dbfcc4d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:44.870767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3cf8-292d-4548-8d63-5b718dbfcc4d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:44.870767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf3cf8-292d-4548-8d63-5b718dbfcc4d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:44.872111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 579/1174] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:44.877243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e4b2e-cddd-4236-ad9b-dcf1db9efcfd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:44.877694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e4b2e-cddd-4236-ad9b-dcf1db9efcfd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:44.877787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e4b2e-cddd-4236-ad9b-dcf1db9efcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:44.895976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-474e4b2e-cddd-4236-ad9b-dcf1db9efcfd None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:44.897195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-474e4b2e-cddd-4236-ad9b-dcf1db9efcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:44.962990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 596/1175] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:45.228479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3cf8-292d-4548-8d63-5b718dbfcc4d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:45.275259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:45.327580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf3cf8-292d-4548-8d63-5b718dbfcc4d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:45.360094 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da03cbfc-e680-4dfd-bd94-24c5b1e557d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:45.360731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03cbfc-e680-4dfd-bd94-24c5b1e557d7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:45.361007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03cbfc-e680-4dfd-bd94-24c5b1e557d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:45.361276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da03cbfc-e680-4dfd-bd94-24c5b1e557d7 None admin] PATH_INFO: `/v3/domains/5b1c272bd7b0432daaa02da18f148bd3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:45.362373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03cbfc-e680-4dfd-bd94-24c5b1e557d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5b1c272bd7b0432daaa02da18f148bd3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:45.363792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da03cbfc-e680-4dfd-bd94-24c5b1e557d7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:45.365371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 580/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Wed Aug 31 09:34:45 2022] GET /identity/v3/domains/5b1c272bd7b0432daaa02da18f148bd3 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:45.371084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e4b2e-cddd-4236-ad9b-dcf1db9efcfd None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:45.425124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:45.467255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e4b2e-cddd-4236-ad9b-dcf1db9efcfd None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:45.499981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2126-2db6-4ec2-a9eb-bde60252c075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:45.500522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2126-2db6-4ec2-a9eb-bde60252c075 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:45.500805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2126-2db6-4ec2-a9eb-bde60252c075 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:45.501074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2126-2db6-4ec2-a9eb-bde60252c075 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:45.501727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2126-2db6-4ec2-a9eb-bde60252c075 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:45.503208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2126-2db6-4ec2-a9eb-bde60252c075 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:45.522890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 597/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:34:45 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:34:47.476824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a50b-5d54-4eaf-8d05-92da14315e5b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:47.477919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a50b-5d54-4eaf-8d05-92da14315e5b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:47.478145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87a50b-5d54-4eaf-8d05-92da14315e5b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:47.479482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 581/1178] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:47.484680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5b79-e73a-4a35-9b6a-6a75f8b77829 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:47.485102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5b79-e73a-4a35-9b6a-6a75f8b77829 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:47.485229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e5b79-e73a-4a35-9b6a-6a75f8b77829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:47.502969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-307e5b79-e73a-4a35-9b6a-6a75f8b77829 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:47.504157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-307e5b79-e73a-4a35-9b6a-6a75f8b77829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:47.568563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 598/1179] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:47.833112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87a50b-5d54-4eaf-8d05-92da14315e5b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:47.933244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87a50b-5d54-4eaf-8d05-92da14315e5b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:47.946168 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:47.966880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90489e84-1d3e-4adc-a262-3c9e73d3edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:47.967497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489e84-1d3e-4adc-a262-3c9e73d3edbc None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:47.967751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489e84-1d3e-4adc-a262-3c9e73d3edbc None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:47.968087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90489e84-1d3e-4adc-a262-3c9e73d3edbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:47.979208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90489e84-1d3e-4adc-a262-3c9e73d3edbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-90489e84-1d3e-4adc-a262-3c9e73d3edbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:47.984047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:47.985230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:34:47.986439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 582/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:47.991079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e5b79-e73a-4a35-9b6a-6a75f8b77829 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:48.032341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:48.088232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e5b79-e73a-4a35-9b6a-6a75f8b77829 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:48.121335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:48.121927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:48.122210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:48.122483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:48.123143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:48.123448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:48.124853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:48.132605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 599/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:48.138961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90489e84-1d3e-4adc-a262-3c9e73d3edbc None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:48.238002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90489e84-1d3e-4adc-a262-3c9e73d3edbc None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:48.270639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c737f-fb36-4650-979e-000eabe7bf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:48.271247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c737f-fb36-4650-979e-000eabe7bf10 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:48.271524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c737f-fb36-4650-979e-000eabe7bf10 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:48.271792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c737f-fb36-4650-979e-000eabe7bf10 None admin] PATH_INFO: `/v3/users/26802a12f7854b47addf59fc4b8eeb20` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:48.284334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c737f-fb36-4650-979e-000eabe7bf10 None admin] RBAC: Authorizing `identity:get_user(user_id=26802a12f7854b47addf59fc4b8eeb20)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:48.285758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c737f-fb36-4650-979e-000eabe7bf10 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:48.287327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 583/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:48 2022] GET /identity/v3/users/26802a12f7854b47addf59fc4b8eeb20 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:48.293433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:48.391127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a406e-20cd-492b-bda4-e028e13fd8ab None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:48.393416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:48.424610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f5c5-5836-4f5d-a4c7-57ea3d1229ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:48.425203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f5c5-5836-4f5d-a4c7-57ea3d1229ef None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:48.425480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f5c5-5836-4f5d-a4c7-57ea3d1229ef None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:48.425750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982f5c5-5836-4f5d-a4c7-57ea3d1229ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:48.490818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982f5c5-5836-4f5d-a4c7-57ea3d1229ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:48.492319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982f5c5-5836-4f5d-a4c7-57ea3d1229ef None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:48.586129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 600/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:34:48.592134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c737f-fb36-4650-979e-000eabe7bf10 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:48.623197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:48.691201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c737f-fb36-4650-979e-000eabe7bf10 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:48.724757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c49a-d4f2-4ef0-b5ee-e038cfb9283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:48.725180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c49a-d4f2-4ef0-b5ee-e038cfb9283c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:48.725456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c49a-d4f2-4ef0-b5ee-e038cfb9283c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:48.725724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c49a-d4f2-4ef0-b5ee-e038cfb9283c None admin] PATH_INFO: `/v3/projects/5cc2b39581254f97a2f74aa81c37553a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:48.726824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c49a-d4f2-4ef0-b5ee-e038cfb9283c None admin] RBAC: Authorizing `identity:get_project(project_id=5cc2b39581254f97a2f74aa81c37553a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:48.728511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c49a-d4f2-4ef0-b5ee-e038cfb9283c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:48.730163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 584/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:48 2022] GET /identity/v3/projects/5cc2b39581254f97a2f74aa81c37553a => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:48.736247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f5c5-5836-4f5d-a4c7-57ea3d1229ef None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:48.739389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:48.833065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982f5c5-5836-4f5d-a4c7-57ea3d1229ef None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:48.865631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1a1db9-05d4-4b76-8e76-e88f950eae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:48.866217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a1db9-05d4-4b76-8e76-e88f950eae44 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:48.866495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a1db9-05d4-4b76-8e76-e88f950eae44 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:48.866762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1a1db9-05d4-4b76-8e76-e88f950eae44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:48.867472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a1db9-05d4-4b76-8e76-e88f950eae44 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=5cc2b39581254f97a2f74aa81c37553a, user.id=26802a12f7854b47addf59fc4b8eeb20) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:48.867774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a1db9-05d4-4b76-8e76-e88f950eae44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:48.869224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1a1db9-05d4-4b76-8e76-e88f950eae44 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:48.874376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 601/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:48 2022] GET /identity/v3/role_assignments?user.id=26802a12f7854b47addf59fc4b8eeb20&scope.project.id=5cc2b39581254f97a2f74aa81c37553a&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:50.748158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211c42-b82b-4a95-81b4-6226af88d269 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:50.748722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211c42-b82b-4a95-81b4-6226af88d269 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:50.748722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78211c42-b82b-4a95-81b4-6226af88d269 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:50.750102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 585/1186] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:50.755368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1dbf4-7af0-4450-9e4d-c76520c0e80c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:50.755821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1dbf4-7af0-4450-9e4d-c76520c0e80c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:50.755924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1dbf4-7af0-4450-9e4d-c76520c0e80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:50.776254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-55e1dbf4-7af0-4450-9e4d-c76520c0e80c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:50.777431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-55e1dbf4-7af0-4450-9e4d-c76520c0e80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:50.837054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:50.842521 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 602/1187] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:51.108138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211c42-b82b-4a95-81b4-6226af88d269 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:51.203274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:51.207594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78211c42-b82b-4a95-81b4-6226af88d269 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:51.239907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241674-3b04-47a1-8a5e-c65d2277fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:51.240537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241674-3b04-47a1-8a5e-c65d2277fbac None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:51.240813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241674-3b04-47a1-8a5e-c65d2277fbac None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:51.241079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241674-3b04-47a1-8a5e-c65d2277fbac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:51.251173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07241674-3b04-47a1-8a5e-c65d2277fbac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-07241674-3b04-47a1-8a5e-c65d2277fbac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:51.255944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:51.257093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:34:51.257946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 586/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:51.263659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1dbf4-7af0-4450-9e4d-c76520c0e80c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:51.359962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1dbf4-7af0-4450-9e4d-c76520c0e80c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:51.395753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:51.396378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:51.396661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:51.396935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:51.397597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:51.397902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:51.399283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:51.407034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 603/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:51.412897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241674-3b04-47a1-8a5e-c65d2277fbac None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:51.509047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241674-3b04-47a1-8a5e-c65d2277fbac None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:51.543278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ae3a3-2648-4476-be65-0894d56eb091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:51.543879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae3a3-2648-4476-be65-0894d56eb091 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:51.544153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae3a3-2648-4476-be65-0894d56eb091 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:51.544451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456ae3a3-2648-4476-be65-0894d56eb091 None admin] PATH_INFO: `/v3/users/26802a12f7854b47addf59fc4b8eeb20` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:51.545547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ae3a3-2648-4476-be65-0894d56eb091 None admin] RBAC: Authorizing `identity:get_user(user_id=26802a12f7854b47addf59fc4b8eeb20)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:51.546957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456ae3a3-2648-4476-be65-0894d56eb091 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:51.548795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 587/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:51 2022] GET /identity/v3/users/26802a12f7854b47addf59fc4b8eeb20 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:51.554575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:51.612507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:51.652610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274ecdf-96be-4b83-a2b1-3fc29e760ff7 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:51.684904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bbee3-b173-470b-bade-f91c9e313cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:51.685529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bbee3-b173-470b-bade-f91c9e313cfe None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:51.685807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bbee3-b173-470b-bade-f91c9e313cfe None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:51.686076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bbee3-b173-470b-bade-f91c9e313cfe None admin] PATH_INFO: `/v3/projects/5cc2b39581254f97a2f74aa81c37553a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:51.687177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bbee3-b173-470b-bade-f91c9e313cfe None admin] RBAC: Authorizing `identity:get_project(project_id=5cc2b39581254f97a2f74aa81c37553a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:51.688649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bbee3-b173-470b-bade-f91c9e313cfe None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:51.690264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 604/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:51 2022] GET /identity/v3/projects/5cc2b39581254f97a2f74aa81c37553a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:51.696680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ae3a3-2648-4476-be65-0894d56eb091 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:51.724715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:51.795322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456ae3a3-2648-4476-be65-0894d56eb091 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:51.829304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e2fe58-c65f-46fa-a4ef-1eb6cd282e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:51.829945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2fe58-c65f-46fa-a4ef-1eb6cd282e3f None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:51.830221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2fe58-c65f-46fa-a4ef-1eb6cd282e3f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:51.830487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e2fe58-c65f-46fa-a4ef-1eb6cd282e3f None admin] PATH_INFO: `/v3/projects/5cc2b39581254f97a2f74aa81c37553a/users/26802a12f7854b47addf59fc4b8eeb20/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:51.832367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2fe58-c65f-46fa-a4ef-1eb6cd282e3f None admin] RBAC: Authorizing `identity:create_grant(project_id=5cc2b39581254f97a2f74aa81c37553a, user_id=26802a12f7854b47addf59fc4b8eeb20, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:51.833776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e2fe58-c65f-46fa-a4ef-1eb6cd282e3f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:51.846095 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 588/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:34:51 2022] PUT /identity/v3/projects/5cc2b39581254f97a2f74aa81c37553a/users/26802a12f7854b47addf59fc4b8eeb20/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:34:53.711057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ea2e-f9af-45b0-a783-7caaa68042d6 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:53.712296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ea2e-f9af-45b0-a783-7caaa68042d6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:53.712296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549ea2e-f9af-45b0-a783-7caaa68042d6 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:53.713503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 605/1193] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:34:53.718666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f6b51-3dbc-4025-af97-d9de7f12b816 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:53.719061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f6b51-3dbc-4025-af97-d9de7f12b816 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:53.719208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f6b51-3dbc-4025-af97-d9de7f12b816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:53.737672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-658f6b51-3dbc-4025-af97-d9de7f12b816 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:34:53.738839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-658f6b51-3dbc-4025-af97-d9de7f12b816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:34:53.803306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 589/1194] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:34:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:34:54.074083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549ea2e-f9af-45b0-a783-7caaa68042d6 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:54.174330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549ea2e-f9af-45b0-a783-7caaa68042d6 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:54.200418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:54.208177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8efaf-479e-4097-bed2-f6f79cc33247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:54.208820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8efaf-479e-4097-bed2-f6f79cc33247 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:54.209101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8efaf-479e-4097-bed2-f6f79cc33247 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:54.209374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8efaf-479e-4097-bed2-f6f79cc33247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:54.219144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8efaf-479e-4097-bed2-f6f79cc33247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-efd8efaf-479e-4097-bed2-f6f79cc33247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:34:54.223966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:34:54.225081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:34:54.226209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 606/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:34:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:34:54.231411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f6b51-3dbc-4025-af97-d9de7f12b816 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:54.249561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:54.328596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f6b51-3dbc-4025-af97-d9de7f12b816 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:54.361111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:54.361707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:54.361984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:54.362252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:54.362902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:54.363198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:54.364577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:54.373288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 590/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:54.379090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8efaf-479e-4097-bed2-f6f79cc33247 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:54.478589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8efaf-479e-4097-bed2-f6f79cc33247 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:54.510932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7697b7-b57f-4e54-ac26-44fcecb146fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:54.511547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7697b7-b57f-4e54-ac26-44fcecb146fb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:54.511828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7697b7-b57f-4e54-ac26-44fcecb146fb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:54.512101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7697b7-b57f-4e54-ac26-44fcecb146fb None admin] PATH_INFO: `/v3/users/26802a12f7854b47addf59fc4b8eeb20` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:54.513237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7697b7-b57f-4e54-ac26-44fcecb146fb None admin] RBAC: Authorizing `identity:get_user(user_id=26802a12f7854b47addf59fc4b8eeb20)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:54.514681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7697b7-b57f-4e54-ac26-44fcecb146fb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:54.516276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 607/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Wed Aug 31 09:34:54 2022] GET /identity/v3/users/26802a12f7854b47addf59fc4b8eeb20 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:54.522219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:54.601836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:54.620719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d11393-1b08-4465-9c0f-5c0a46fafc5d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:54.653485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3b073-b799-4ba0-aedc-430442e60540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:54.654072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b073-b799-4ba0-aedc-430442e60540 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:54.654351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b073-b799-4ba0-aedc-430442e60540 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:54.654623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3b073-b799-4ba0-aedc-430442e60540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:54.720108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3b073-b799-4ba0-aedc-430442e60540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:54.721579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a3b073-b799-4ba0-aedc-430442e60540 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:54.797235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:54.817274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 591/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:34:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:34:54.824793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7697b7-b57f-4e54-ac26-44fcecb146fb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:54.879796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:34:54.924211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7697b7-b57f-4e54-ac26-44fcecb146fb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:54.957928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd621215-d3fc-4e9b-8cc9-2431d75a9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:54.958555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621215-d3fc-4e9b-8cc9-2431d75a9eee None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:54.958840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621215-d3fc-4e9b-8cc9-2431d75a9eee None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:54.959119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621215-d3fc-4e9b-8cc9-2431d75a9eee None admin] PATH_INFO: `/v3/projects/5cc2b39581254f97a2f74aa81c37553a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:54.960262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd621215-d3fc-4e9b-8cc9-2431d75a9eee None admin] RBAC: Authorizing `identity:get_project(project_id=5cc2b39581254f97a2f74aa81c37553a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:54.962335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd621215-d3fc-4e9b-8cc9-2431d75a9eee None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:54.963961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 608/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Wed Aug 31 09:34:54 2022] GET /identity/v3/projects/5cc2b39581254f97a2f74aa81c37553a => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:34:54.970152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3b073-b799-4ba0-aedc-430442e60540 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:34:55.067866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3b073-b799-4ba0-aedc-430442e60540 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:34:55.100684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f98da-6993-4f06-8e24-6bd2fcae2e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:34:55.101267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f98da-6993-4f06-8e24-6bd2fcae2e79 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:34:55.101545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f98da-6993-4f06-8e24-6bd2fcae2e79 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:34:55.101838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f98da-6993-4f06-8e24-6bd2fcae2e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:34:55.103086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f98da-6993-4f06-8e24-6bd2fcae2e79 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=5cc2b39581254f97a2f74aa81c37553a, user.id=26802a12f7854b47addf59fc4b8eeb20) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:34:55.103384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f98da-6993-4f06-8e24-6bd2fcae2e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:34:55.104855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f98da-6993-4f06-8e24-6bd2fcae2e79 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:34:55.110354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 592/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:34:54 2022] GET /identity/v3/role_assignments?user.id=26802a12f7854b47addf59fc4b8eeb20&scope.project.id=5cc2b39581254f97a2f74aa81c37553a&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:04.953867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=38 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:05.107812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=78 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:50.669403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15decc-0ae9-4fb2-a3c1-9c84144e64ab None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:50.670220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15decc-0ae9-4fb2-a3c1-9c84144e64ab None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:50.670504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15decc-0ae9-4fb2-a3c1-9c84144e64ab None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:50.672460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 609/1201] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:35:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:35:50.679132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a651c9c-0b18-4e8f-a624-9da63114707e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:50.679595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a651c9c-0b18-4e8f-a624-9da63114707e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:50.679779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a651c9c-0b18-4e8f-a624-9da63114707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:50.704331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5a651c9c-0b18-4e8f-a624-9da63114707e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:35:50.705810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5a651c9c-0b18-4e8f-a624-9da63114707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:35:50.802292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 593/1202] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:35:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:35:51.082057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15decc-0ae9-4fb2-a3c1-9c84144e64ab None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:51.209897 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15decc-0ae9-4fb2-a3c1-9c84144e64ab None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:51.251512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:51.252132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:51.252445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:51.252759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:51.264341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:51.265970 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:35:51.281824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:35:51.282983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:35:51.283974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:35:51.283974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:35:51.283974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:35:51.283974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 610/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:35:51.289146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a651c9c-0b18-4e8f-a624-9da63114707e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:51.421225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a651c9c-0b18-4e8f-a624-9da63114707e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:51.469762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:51.477507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4276cb-7faa-4135-b9cb-21204f0e3aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:51.478432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4276cb-7faa-4135-b9cb-21204f0e3aaa None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:51.478940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4276cb-7faa-4135-b9cb-21204f0e3aaa None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:51.479388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4276cb-7faa-4135-b9cb-21204f0e3aaa None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:51.480283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4276cb-7faa-4135-b9cb-21204f0e3aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:51.480721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4276cb-7faa-4135-b9cb-21204f0e3aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:51.482520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4276cb-7faa-4135-b9cb-21204f0e3aaa None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:51.498571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 594/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:51.509482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:51.580101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:51.643069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae71ba96-d7ee-4c2b-ac8e-a5b8be9b2061 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:51.681997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf1c8e-9b4b-466b-9076-b5971f7a5de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:51.683514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf1c8e-9b4b-466b-9076-b5971f7a5de0 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:51.684003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf1c8e-9b4b-466b-9076-b5971f7a5de0 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:51.684505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf1c8e-9b4b-466b-9076-b5971f7a5de0 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:51.685365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf1c8e-9b4b-466b-9076-b5971f7a5de0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:51.687011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf1c8e-9b4b-466b-9076-b5971f7a5de0 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:51.728506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 611/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Wed Aug 31 09:35:51 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:35:53.906989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bff94-72f5-47d3-8a2f-56e49be19f9f None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:53.908515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bff94-72f5-47d3-8a2f-56e49be19f9f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:53.908515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bff94-72f5-47d3-8a2f-56e49be19f9f None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:53.912201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 595/1206] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:35:53.914597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2d98b-b06c-40af-b9a4-a95893ca3867 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:53.915678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2d98b-b06c-40af-b9a4-a95893ca3867 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:53.915821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2d98b-b06c-40af-b9a4-a95893ca3867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:53.936286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4cf2d98b-b06c-40af-b9a4-a95893ca3867 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:35:53.937591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4cf2d98b-b06c-40af-b9a4-a95893ca3867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:35:54.024297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 612/1207] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:35:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:35:54.322874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bff94-72f5-47d3-8a2f-56e49be19f9f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:54.449894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bff94-72f5-47d3-8a2f-56e49be19f9f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:54.488378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab93a2d-0bfe-4190-ade1-9a2bc5f3e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:54.489015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab93a2d-0bfe-4190-ade1-9a2bc5f3e32f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:54.489294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab93a2d-0bfe-4190-ade1-9a2bc5f3e32f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:54.491627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab93a2d-0bfe-4190-ade1-9a2bc5f3e32f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:54.503504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab93a2d-0bfe-4190-ade1-9a2bc5f3e32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-3ab93a2d-0bfe-4190-ade1-9a2bc5f3e32f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:35:54.509277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:35:54.511160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:35:54.512395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 596/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:35:54.516501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2d98b-b06c-40af-b9a4-a95893ca3867 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:54.563054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:54.633521 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2d98b-b06c-40af-b9a4-a95893ca3867 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:54.675940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:54.676572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:54.676859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:54.677119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:54.677783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:54.678083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:54.679447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:54.689470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 613/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:54.695262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab93a2d-0bfe-4190-ade1-9a2bc5f3e32f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:54.756845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:54.815229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab93a2d-0bfe-4190-ade1-9a2bc5f3e32f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:54.854705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:54.855350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:54.855647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:54.855958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:54.870284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:54.871764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:35:54.888086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:35:54.894121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:35:54.895254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:35:54.895254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:35:54.895254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:35:54.895254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 597/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:35:54.895524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:55.017635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:55.022902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd4983-3d8a-4158-a9ac-850d540284f1 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:55.066455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:55.067183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:55.067713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:55.067826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:55.068433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:55.068753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:55.070298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:55.084331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 614/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:55.091100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:55.212153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f037b-baf6-40bb-ad80-197b57f42bd7 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:55.212153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:55.254712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:55.255257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:55.257243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:55.257243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:55.265503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:55.267287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:35:55.281140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:35:55.282443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:35:55.283696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:35:55.285181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 598/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:35:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:35:55.292759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:55.411511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234abc4b-b8d2-4c18-ac0a-55327ed70c11 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:55.451761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:55.452404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:55.452693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:55.452973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:55.453788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:55.454025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:55.455606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:55.476266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 615/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 31 09:35:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:55.482898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:55.600752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c08e36-d736-40db-a73d-f337fd663b45 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:55.640695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a2283-c2af-40ba-b1ee-e9b05b1f05eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:55.641385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2283-c2af-40ba-b1ee-e9b05b1f05eb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:55.641670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2283-c2af-40ba-b1ee-e9b05b1f05eb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:55.641941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a2283-c2af-40ba-b1ee-e9b05b1f05eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:55.688978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:55.747539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a2283-c2af-40ba-b1ee-e9b05b1f05eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:55.749503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a2283-c2af-40ba-b1ee-e9b05b1f05eb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:55.862481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 599/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:35:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:35:55.868907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:55.890339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:55.980850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1f2bb-be93-4d89-837a-00773a6c7a6b None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:56.031557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:56.032221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:56.032537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:56.032903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:56.045045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:56.046885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:35:56.062980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:35:56.064290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:35:56.065544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:35:56.065544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:35:56.065544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:35:56.069370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 616/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:35:56.070218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a2283-c2af-40ba-b1ee-e9b05b1f05eb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:56.144494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:56.191943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a2283-c2af-40ba-b1ee-e9b05b1f05eb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:56.233246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:56.233875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:56.234161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:56.234438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:56.235092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:56.235397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:56.237019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:56.251061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 600/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:35:56.256923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:56.357577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:56.393233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43c7a1-1705-4640-9d81-0bb9f6975546 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:56.428544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:56.429266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:56.429556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:56.429786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:56.438039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:56.439607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:35:56.453774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:35:56.454822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:35:56.461256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 617/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:35:56.462048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:56.582288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9969fb6-4cdf-4eb5-bd89-65bb95a560b5 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:56.616718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:56.630748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1908e5-b6ad-4d0c-89a0-f51a83481961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:56.631522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1908e5-b6ad-4d0c-89a0-f51a83481961 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:56.631809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1908e5-b6ad-4d0c-89a0-f51a83481961 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:56.632088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1908e5-b6ad-4d0c-89a0-f51a83481961 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:56.633032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1908e5-b6ad-4d0c-89a0-f51a83481961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:56.634144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1908e5-b6ad-4d0c-89a0-f51a83481961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:56.636192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1908e5-b6ad-4d0c-89a0-f51a83481961 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:56.657599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 601/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:35:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:56.659615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:56.797122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877313ed-86d8-4f99-843f-7771db2d0cbb None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:56.827714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:56.834412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36546711-f1c8-48c0-bc0e-a74a6b3c287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:56.836097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546711-f1c8-48c0-bc0e-a74a6b3c287e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:56.836454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546711-f1c8-48c0-bc0e-a74a6b3c287e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:56.836777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36546711-f1c8-48c0-bc0e-a74a6b3c287e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:56.837693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36546711-f1c8-48c0-bc0e-a74a6b3c287e None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=55fa039431004ca19da7c95ad6f428a4) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:56.838003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36546711-f1c8-48c0-bc0e-a74a6b3c287e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:56.839550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36546711-f1c8-48c0-bc0e-a74a6b3c287e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:56.845163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 618/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:35:56 2022] GET /identity/v3/role_assignments?user.id=55fa039431004ca19da7c95ad6f428a4&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:58.871855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42036d9-b2a7-43f1-bc9e-3f48362cb96b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:58.872509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42036d9-b2a7-43f1-bc9e-3f48362cb96b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:58.872509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42036d9-b2a7-43f1-bc9e-3f48362cb96b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:58.873950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 602/1220] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:35:58.879427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71641bd-f3ba-4685-9968-eee255cd5ab5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:58.879933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71641bd-f3ba-4685-9968-eee255cd5ab5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:58.880026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71641bd-f3ba-4685-9968-eee255cd5ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:58.898180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e71641bd-f3ba-4685-9968-eee255cd5ab5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:35:58.900122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e71641bd-f3ba-4685-9968-eee255cd5ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:35:58.973173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 619/1221] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:35:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:35:59.256187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42036d9-b2a7-43f1-bc9e-3f48362cb96b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:59.372412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42036d9-b2a7-43f1-bc9e-3f48362cb96b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:59.411753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d2235-a336-4b96-a7d4-4b30ad3bc08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:59.412665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d2235-a336-4b96-a7d4-4b30ad3bc08f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:59.413042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d2235-a336-4b96-a7d4-4b30ad3bc08f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:59.413408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148d2235-a336-4b96-a7d4-4b30ad3bc08f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:59.425610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148d2235-a336-4b96-a7d4-4b30ad3bc08f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-148d2235-a336-4b96-a7d4-4b30ad3bc08f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:35:59.431888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:35:59.433110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:35:59.434172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 603/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:35:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:35:59.439341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71641bd-f3ba-4685-9968-eee255cd5ab5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:59.544222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71641bd-f3ba-4685-9968-eee255cd5ab5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:59.568589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:59.580647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:59.581247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:59.581534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:59.581829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:59.582529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] RBAC: Adding query filter params (name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:59.582830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:59.584227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:59.592229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 620/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:59.598134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d2235-a336-4b96-a7d4-4b30ad3bc08f None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:59.646745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:35:59.716496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148d2235-a336-4b96-a7d4-4b30ad3bc08f None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:59.753364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:59.754056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:59.754308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:59.754569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:59.765937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:59.767388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:35:59.783964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:35:59.785249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:35:59.786336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:35:59.786336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:35:59.786336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:35:59.786336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 604/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:35:59.791649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:35:59.901311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b07d1-fb49-45b1-b34a-e0caffc481fa None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:35:59.936478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:35:59.937087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:35:59.937372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:35:59.937646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:35:59.938292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:35:59.938650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:35:59.940061 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:35:59.952627 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 621/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:35:59.958888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:00.064959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:00.072848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3c4ce-3a26-4fe1-a71b-68f309a7d209 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:00.111980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:00.112824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:00.113146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:00.113411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] PATH_INFO: `/v3/users/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:00.122170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:00.123624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:36:00.135845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:00.137103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:00.138078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 605/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:35:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:00.143348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:00.198640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:00.257542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726de1f-4418-448b-8bd9-d81a63b875cc None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:00.297143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:00.297875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:00.298236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:00.298569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:00.299392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:00.299719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:00.301478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:00.321282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 622/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 31 09:36:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:00.327152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:00.432259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444b84b-ad59-4925-824e-6b8b4c413fdf None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:00.467775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:00.468357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:00.468642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:00.468921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:00.481988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:00.483454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:00.498853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:00.500061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:00.501143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:00.501143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:00.501143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:00.501143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 606/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:00.506133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:00.614625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34708c-ea97-4f35-8078-5e2abfd41e4e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:00.617375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:00.656371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:00.656973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:00.657255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:00.657559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:00.658197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:00.658496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:00.659917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:00.673147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 623/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:00.678925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:00.690851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:00.795404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6af20-f42f-4c86-959a-53cdba20faa3 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:00.833263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:00.834053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:00.834395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:00.834713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:00.843392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:00.845137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:36:00.857802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:00.858724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:00.859765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 607/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:36:00.864990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:00.971779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec6d83-08fa-415a-a538-c1e8939671d5 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:01.014929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d7b9d-da6d-4264-8d8e-7316574c4c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:01.015651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7b9d-da6d-4264-8d8e-7316574c4c82 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:01.016039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7b9d-da6d-4264-8d8e-7316574c4c82 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:01.016448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d7b9d-da6d-4264-8d8e-7316574c4c82 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:01.017587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7b9d-da6d-4264-8d8e-7316574c4c82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:01.018067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7b9d-da6d-4264-8d8e-7316574c4c82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:01.020093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d7b9d-da6d-4264-8d8e-7316574c4c82 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:01.035787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 624/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:01.041852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:01.118928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:01.160294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c558e35b-6f21-4c63-955e-17b2a3043c73 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:01.201373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee2dfda-fb9f-49fa-a24c-636c95eebb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:01.202094 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dfda-fb9f-49fa-a24c-636c95eebb74 None admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:01.202411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dfda-fb9f-49fa-a24c-636c95eebb74 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:01.202725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee2dfda-fb9f-49fa-a24c-636c95eebb74 None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/55fa039431004ca19da7c95ad6f428a4/roles/debd25f091134ad1a9b107790a189b51` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:01.217988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2dfda-fb9f-49fa-a24c-636c95eebb74 None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=55fa039431004ca19da7c95ad6f428a4, role_id=debd25f091134ad1a9b107790a189b51)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:01.219588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee2dfda-fb9f-49fa-a24c-636c95eebb74 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:01.232112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 608/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:36:01 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/55fa039431004ca19da7c95ad6f428a4/roles/debd25f091134ad1a9b107790a189b51 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:36:03.215599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7d8d-fef9-430f-a907-0e41a02d4bd3 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:03.216139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7d8d-fef9-430f-a907-0e41a02d4bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:03.216139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f7d8d-fef9-430f-a907-0e41a02d4bd3 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:03.217754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 625/1233] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:36:03.223146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ead9ad-fbe1-4ef4-80de-22935af140b1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:03.223625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ead9ad-fbe1-4ef4-80de-22935af140b1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:03.223797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ead9ad-fbe1-4ef4-80de-22935af140b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:03.243545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f8ead9ad-fbe1-4ef4-80de-22935af140b1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:36:03.244761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f8ead9ad-fbe1-4ef4-80de-22935af140b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:36:03.319381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 609/1234] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:36:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:36:03.592267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f7d8d-fef9-430f-a907-0e41a02d4bd3 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:03.619425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:03.703676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f7d8d-fef9-430f-a907-0e41a02d4bd3 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:03.741831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643867c6-484a-4d04-b0df-6e02483c5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:03.742546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643867c6-484a-4d04-b0df-6e02483c5e24 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:03.742857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643867c6-484a-4d04-b0df-6e02483c5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:03.743183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643867c6-484a-4d04-b0df-6e02483c5e24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:03.754418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643867c6-484a-4d04-b0df-6e02483c5e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-643867c6-484a-4d04-b0df-6e02483c5e24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:36:03.760119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:03.761264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:03.762659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 626/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Wed Aug 31 09:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:03.767580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ead9ad-fbe1-4ef4-80de-22935af140b1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:03.820397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:03.878968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ead9ad-fbe1-4ef4-80de-22935af140b1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:03.914778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:03.915394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:03.915676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:03.915945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:03.916650 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] RBAC: Adding query filter params (name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:03.916949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:03.918316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:03.926784 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 610/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Wed Aug 31 09:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:03.933447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643867c6-484a-4d04-b0df-6e02483c5e24 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:04.027922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:04.045496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643867c6-484a-4d04-b0df-6e02483c5e24 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:04.082724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:04.083555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:04.083971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:04.084387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:04.096007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:04.097537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:04.119393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:04.120641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:04.121953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:04.121953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:04.121953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:04.121953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 627/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:04.126560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:04.242281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a6f16-8bb8-4bdb-ad27-c14897d1469d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:04.253377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:04.279672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:04.280311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:04.280596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:04.280871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:04.281518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:04.281830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:04.283670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:04.299725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 611/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:04.306520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:04.415837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daca9a8-caf8-4d5f-a4c2-127d251aad37 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:04.452310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:04.452938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:04.453217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:04.453484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:04.456451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:04.463220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:04.464909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:36:04.478413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:04.479633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:04.480867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 628/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:36:04.486701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:04.603154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdc356-f6c2-444d-ae51-83daf76d6ccb None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:04.644101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:04.644815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:04.645172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:04.645450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:04.646194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:04.646501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:04.648248 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:04.668577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 612/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 31 09:36:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:04.674865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:04.792109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b24e82-6c3d-4149-a63b-0c6799555817 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:04.829606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac24dc9-c577-4fe4-9b52-8e1c45824b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:04.830210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac24dc9-c577-4fe4-9b52-8e1c45824b8c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:04.830489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac24dc9-c577-4fe4-9b52-8e1c45824b8c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:04.830759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac24dc9-c577-4fe4-9b52-8e1c45824b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:04.896612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:04.903780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac24dc9-c577-4fe4-9b52-8e1c45824b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:04.905453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac24dc9-c577-4fe4-9b52-8e1c45824b8c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:05.013065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 629/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:36:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:36:05.019230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:05.056857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:05.139374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcc8ec-003f-4e7e-980f-84b7767a1ce6 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:05.178529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:05.179186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:05.179468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:05.179742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:05.191133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:05.192640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:05.209969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:05.211501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:05.212534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:05.212534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:05.212534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:05.212534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 613/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:36:05.218371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac24dc9-c577-4fe4-9b52-8e1c45824b8c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:05.323508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:05.329827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac24dc9-c577-4fe4-9b52-8e1c45824b8c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:05.366877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:05.368082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:05.368432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:05.368732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:05.369400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:05.369773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:05.371242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:05.383066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 630/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:05.390443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:05.480197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:05.503132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a080665-c749-4d89-b367-fd3efae49948 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:05.538072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:05.538710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:05.539047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:05.539934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:05.547531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:05.549072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:36:05.561708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:05.562950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:05.563877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 614/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:05.569287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:05.677357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58407ac7-f1f6-4bce-83e8-833ea34e6238 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:05.713712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cd02b-b562-4c42-9f32-67874f3b9538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:05.714327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd02b-b562-4c42-9f32-67874f3b9538 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:05.714610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd02b-b562-4c42-9f32-67874f3b9538 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:05.714890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cd02b-b562-4c42-9f32-67874f3b9538 None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:05.715629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd02b-b562-4c42-9f32-67874f3b9538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:05.715934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd02b-b562-4c42-9f32-67874f3b9538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:05.717465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cd02b-b562-4c42-9f32-67874f3b9538 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:05.730580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 631/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:05.736738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:05.842734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b498-d1bc-4eaf-9f37-0c85d09866ea None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:05.879417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd618636-cd02-47cd-9dcd-d3eef5601b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:05.880082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618636-cd02-47cd-9dcd-d3eef5601b9f None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:05.880326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618636-cd02-47cd-9dcd-d3eef5601b9f None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:05.880594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd618636-cd02-47cd-9dcd-d3eef5601b9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:05.881352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618636-cd02-47cd-9dcd-d3eef5601b9f None admin] RBAC: Adding query filter params (role.id=debd25f091134ad1a9b107790a189b51, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=55fa039431004ca19da7c95ad6f428a4) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:05.881653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618636-cd02-47cd-9dcd-d3eef5601b9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:05.883205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd618636-cd02-47cd-9dcd-d3eef5601b9f None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:05.890212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 615/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:36:05 2022] GET /identity/v3/role_assignments?user.id=55fa039431004ca19da7c95ad6f428a4&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=debd25f091134ad1a9b107790a189b51 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:36:07.954548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c943d-c23b-41d3-9b83-a6b6ba3472d9 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:07.955101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c943d-c23b-41d3-9b83-a6b6ba3472d9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:07.955101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c943d-c23b-41d3-9b83-a6b6ba3472d9 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:07.956456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 632/1247] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:36:07.966802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280ef7-96bc-48e6-a8fd-e41e91ae1392 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:07.966802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280ef7-96bc-48e6-a8fd-e41e91ae1392 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:07.966802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9280ef7-96bc-48e6-a8fd-e41e91ae1392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:07.971823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:07.988243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a9280ef7-96bc-48e6-a8fd-e41e91ae1392 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:36:07.989933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a9280ef7-96bc-48e6-a8fd-e41e91ae1392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:36:08.080603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 616/1248] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:36:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:36:08.410039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c943d-c23b-41d3-9b83-a6b6ba3472d9 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:08.434389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:08.535660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c943d-c23b-41d3-9b83-a6b6ba3472d9 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:08.574334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a67ab4-86bf-42b2-9d84-4a84ec4cfa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:08.574971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a67ab4-86bf-42b2-9d84-4a84ec4cfa89 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:08.575282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a67ab4-86bf-42b2-9d84-4a84ec4cfa89 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:08.575563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a67ab4-86bf-42b2-9d84-4a84ec4cfa89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:08.586791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a67ab4-86bf-42b2-9d84-4a84ec4cfa89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-57a67ab4-86bf-42b2-9d84-4a84ec4cfa89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:36:08.591848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:08.592926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:08.594112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 633/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:36:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:36:08.599725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9280ef7-96bc-48e6-a8fd-e41e91ae1392 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:08.717974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9280ef7-96bc-48e6-a8fd-e41e91ae1392 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:08.753575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:08.763253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:08.763875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:08.764156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:08.764459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:08.765131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:08.765440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:08.766811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:08.775887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 617/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:36:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:08.782122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a67ab4-86bf-42b2-9d84-4a84ec4cfa89 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:08.865409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:08.893865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a67ab4-86bf-42b2-9d84-4a84ec4cfa89 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:08.929666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:08.930997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:08.931335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:08.931589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:08.942126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:08.943733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:08.959042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:08.960672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:08.961951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:08.961951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:08.961951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:08.961951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 634/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:08.966504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:09.087127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52eefc7-e04b-4f8a-ae7f-c9862aba3cb8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:09.124327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:09.124933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:09.125229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:09.125483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:09.126209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:09.126595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:09.127977 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:09.139982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 618/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:09.145768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:09.260283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63db8-19b6-4df6-91ad-5453b90cbb32 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:09.286994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:09.295830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:09.296754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:09.297037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:09.297316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:09.305785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:09.307238 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:36:09.318678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:09.319977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:09.322014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 635/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 09:36:09.326731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:09.384634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:09.432472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de80985-1828-4223-bf0a-71c9babc9708 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:09.471627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:09.472320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:09.472705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:09.472959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:09.473702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:09.474014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:09.475455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:09.493866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 619/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 31 09:36:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:09.499849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:09.612045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bba39a-4a57-46cf-9fed-e53c35c4cb1c None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:09.647545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb473166-8e1a-453c-8211-2974b124067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:09.648064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473166-8e1a-453c-8211-2974b124067d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:09.648387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473166-8e1a-453c-8211-2974b124067d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:09.649282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb473166-8e1a-453c-8211-2974b124067d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:09.717991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:09.734665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb473166-8e1a-453c-8211-2974b124067d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:09.736453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb473166-8e1a-453c-8211-2974b124067d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:09.841312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 636/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:36:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:36:09.847414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:09.954198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14df0a73-5819-4763-addc-6cb16e13b53b None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:09.969530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:09.993758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:09.994426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:09.994699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:09.995005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:10.006609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:10.008301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:10.030240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:10.031262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:10.037246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:10.037246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:10.037246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:10.037246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 620/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:10.037925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb473166-8e1a-453c-8211-2974b124067d None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:10.132038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:10.145806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb473166-8e1a-453c-8211-2974b124067d None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:10.183426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:10.184034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:10.184423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:10.184695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:10.185361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:10.185660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:10.187025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:10.199283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 637/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:10.205341 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:10.320275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48d770-2c87-4a4a-a51f-12350f00e963 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:10.356596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:10.357243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:10.357526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:10.357807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:10.365425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:10.366904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:36:10.380459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:10.381648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:10.387708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 621/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:10.388479 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:10.497371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d79529-bad4-4cb9-8bdc-fd57a63c6374 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:10.532594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc153f-c266-4977-bf08-1f69434a8b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:10.533213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc153f-c266-4977-bf08-1f69434a8b5d None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:10.533498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc153f-c266-4977-bf08-1f69434a8b5d None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:10.533774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc153f-c266-4977-bf08-1f69434a8b5d None admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:10.534486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc153f-c266-4977-bf08-1f69434a8b5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:10.534794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc153f-c266-4977-bf08-1f69434a8b5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:10.536283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc153f-c266-4977-bf08-1f69434a8b5d None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:10.550053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 638/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:36:10.557112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:10.584849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:10.666402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f58d9-2ba5-4758-aac0-9a5a30b4b710 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:10.706481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9a51-2c80-42d4-951f-73d2eb24e2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:10.707113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9a51-2c80-42d4-951f-73d2eb24e2ef None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:10.707392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9a51-2c80-42d4-951f-73d2eb24e2ef None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:10.707742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9a51-2c80-42d4-951f-73d2eb24e2ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:10.708714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9a51-2c80-42d4-951f-73d2eb24e2ef None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=55fa039431004ca19da7c95ad6f428a4) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:10.709059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9a51-2c80-42d4-951f-73d2eb24e2ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:10.710513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9a51-2c80-42d4-951f-73d2eb24e2ef None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:10.717079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 622/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:36:10 2022] GET /identity/v3/role_assignments?user.id=55fa039431004ca19da7c95ad6f428a4&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:12.583846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3604f-7cc5-439f-868e-24d6660af0a3 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:12.584401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3604f-7cc5-439f-868e-24d6660af0a3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:12.584401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3604f-7cc5-439f-868e-24d6660af0a3 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:12.585749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 639/1261] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:36:12.590973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6da7f-8ba5-4ec6-967c-036674c22e7e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:12.591393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6da7f-8ba5-4ec6-967c-036674c22e7e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:12.591531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6da7f-8ba5-4ec6-967c-036674c22e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:12.610102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9ba6da7f-8ba5-4ec6-967c-036674c22e7e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:36:12.611279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9ba6da7f-8ba5-4ec6-967c-036674c22e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:36:12.677636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 623/1262] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:36:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:36:12.942298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3604f-7cc5-439f-868e-24d6660af0a3 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:12.953114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:13.052291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3604f-7cc5-439f-868e-24d6660af0a3 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:13.085139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ec99-1f4f-497b-a00f-1212b37fd91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:13.085752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ec99-1f4f-497b-a00f-1212b37fd91e None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:13.086561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ec99-1f4f-497b-a00f-1212b37fd91e None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:13.086834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ec99-1f4f-497b-a00f-1212b37fd91e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:13.096918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712ec99-1f4f-497b-a00f-1212b37fd91e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-5712ec99-1f4f-497b-a00f-1212b37fd91e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:36:13.102574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:13.103654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:13.104820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 640/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:36:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:13.109755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6da7f-8ba5-4ec6-967c-036674c22e7e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:13.127740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:13.205594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6da7f-8ba5-4ec6-967c-036674c22e7e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:13.238896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:13.239491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:13.239771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:13.240042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:13.240724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:13.241025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:13.242637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:13.250469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 624/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:36:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:13.256068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ec99-1f4f-497b-a00f-1212b37fd91e None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:13.323763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:13.356121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ec99-1f4f-497b-a00f-1212b37fd91e None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:13.389129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:13.389744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:13.390029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:13.390304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:13.400703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:13.402163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:13.416493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:13.417441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:13.418372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:13.418372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:13.418372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:13.418372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 641/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:13.423692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:13.502505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:13.521774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ca12a-2b1f-41f1-ad00-788f787c342d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:13.554685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:13.555498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:13.555782 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:13.556054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:13.556723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:13.557066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:13.558427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:13.569840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 625/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:13.575862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:13.675527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2407024e-7276-4cc5-8c01-a4c25f62331f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:13.695491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:13.709898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:13.710519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:13.710806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:13.711697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:13.719094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:13.720603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:36:13.734013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:13.735164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:13.736566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 642/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:13.740817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:13.840819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b10e9-5a50-4143-8c28-f337536c5bba None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:13.873289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:13.873877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:13.874153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:13.874421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:13.875135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:13.875436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:13.876865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:13.885130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:13.893547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 626/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 31 09:36:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:13.899951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:14.006100 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00cd14-0483-4994-9c78-71b0ee81efb2 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:14.044101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:14.044953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:14.045233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:14.045505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:14.056624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:14.058127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:14.074382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:14.075382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:14.076489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:14.076489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:14.076489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:14.076489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 643/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:14.082718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:14.180266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01beb30f-9657-47fd-b0c4-5f03b81fef33 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:14.213705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:14.214300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:14.214580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:14.214852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:14.215489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:14.215788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:14.217180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:14.228020 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 627/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:14.233611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:14.265765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:14.333412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9538e1-1575-4a95-bbd5-87a6034bdccc None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:14.366172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:14.366786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:14.367069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:14.367946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:14.374617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:14.376063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:36:14.387828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:14.388944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:14.390350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 644/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:14.394721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:14.458963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:14.500479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac6fb60-6294-4e9f-8672-eb5170e949c8 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:14.533960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5c24d-238b-4e19-8e30-640064bfa617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:14.534588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5c24d-238b-4e19-8e30-640064bfa617 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:14.534853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5c24d-238b-4e19-8e30-640064bfa617 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:14.535129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5c24d-238b-4e19-8e30-640064bfa617 None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:14.535819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5c24d-238b-4e19-8e30-640064bfa617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:14.536124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5c24d-238b-4e19-8e30-640064bfa617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:14.537570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5c24d-238b-4e19-8e30-640064bfa617 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:14.549668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 628/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:14.556138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:14.644209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:14.652854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095960a5-e35e-4155-a5c6-e501210c9f9f None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:14.685859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe55d7-6dc4-4050-ad17-0c79161b269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:14.686504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe55d7-6dc4-4050-ad17-0c79161b269b None admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:14.686782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe55d7-6dc4-4050-ad17-0c79161b269b None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:14.687056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe55d7-6dc4-4050-ad17-0c79161b269b None admin] PATH_INFO: `/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/55fa039431004ca19da7c95ad6f428a4/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:14.689056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe55d7-6dc4-4050-ad17-0c79161b269b None admin] RBAC: Authorizing `identity:create_grant(project_id=2bf987a0692345ed85d0121efd2c30c6, user_id=55fa039431004ca19da7c95ad6f428a4, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:14.690505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fe55d7-6dc4-4050-ad17-0c79161b269b None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:14.704150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 645/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Wed Aug 31 09:36:14 2022] PUT /identity/v3/projects/2bf987a0692345ed85d0121efd2c30c6/users/55fa039431004ca19da7c95ad6f428a4/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:36:16.575283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6901eba-df80-4ed8-a4bf-bc33ea248988 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:16.575836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6901eba-df80-4ed8-a4bf-bc33ea248988 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:16.575836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6901eba-df80-4ed8-a4bf-bc33ea248988 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:16.577209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 629/1274] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:36:16.582284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9318588-9bb4-4e30-9dd8-a00202367eef None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:16.582671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9318588-9bb4-4e30-9dd8-a00202367eef None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:16.582835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9318588-9bb4-4e30-9dd8-a00202367eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:16.600584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b9318588-9bb4-4e30-9dd8-a00202367eef None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:36:16.602339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b9318588-9bb4-4e30-9dd8-a00202367eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:36:16.666910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 646/1275] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:36:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:36:16.930745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6901eba-df80-4ed8-a4bf-bc33ea248988 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:17.043106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6901eba-df80-4ed8-a4bf-bc33ea248988 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:17.064731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:17.081484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ca6e-2d19-4306-b6e6-dff0cca1559e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:17.082104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ca6e-2d19-4306-b6e6-dff0cca1559e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:17.082382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ca6e-2d19-4306-b6e6-dff0cca1559e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:17.082653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07ca6e-2d19-4306-b6e6-dff0cca1559e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:17.092897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07ca6e-2d19-4306-b6e6-dff0cca1559e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-7a07ca6e-2d19-4306-b6e6-dff0cca1559e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 09:36:17.097808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:17.098904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:17.099958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 630/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Wed Aug 31 09:36:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:17.105595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9318588-9bb4-4e30-9dd8-a00202367eef None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:17.184161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:17.202770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9318588-9bb4-4e30-9dd8-a00202367eef None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:17.235588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:17.236195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:17.236488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:17.236760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:17.237413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:17.237713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:17.239075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:17.247586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 647/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Wed Aug 31 09:36:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:17.253201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ca6e-2d19-4306-b6e6-dff0cca1559e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:17.350546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07ca6e-2d19-4306-b6e6-dff0cca1559e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:17.383379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:17.383978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:17.384282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:17.384551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:17.394488 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:17.395900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:17.410265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:17.411196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:17.412337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:17.412337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:17.412337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:17.412337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 631/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:17.417954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:17.513754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c842a64c-b378-4928-a960-9b5e8030c714 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:17.545977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:17.546819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:17.547098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:17.547369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:17.547999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:17.548327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:17.549700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:17.560854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 648/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:17.566398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:17.596599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:17.665354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d89fb-d843-47c5-8ecc-03cc59f4ee9e None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:17.697925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:17.698543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:17.698822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:17.699091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:17.706190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:17.707612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 09:36:17.719004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:17.719969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:17.721072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 632/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:17.725905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:17.730427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:17.825742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f959af-51ff-42ba-ba91-f78a959f20ee None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:17.858836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:17.859436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:17.859718 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:17.859994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:17.860751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:17.861063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:17.862507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:17.878906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 649/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Wed Aug 31 09:36:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:17.885225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:17.975545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:17.986026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052b62c-fec3-437a-9ec1-535125eb6f54 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:18.019846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4edff-a9dd-4b28-b135-9227c065f4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:18.020472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4edff-a9dd-4b28-b135-9227c065f4a9 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:18.020758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4edff-a9dd-4b28-b135-9227c065f4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:18.021035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4edff-a9dd-4b28-b135-9227c065f4a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:18.091159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4edff-a9dd-4b28-b135-9227c065f4a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:18.092567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4edff-a9dd-4b28-b135-9227c065f4a9 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:18.180411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:18.190864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 633/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Wed Aug 31 09:36:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 09:36:18.196690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:18.255952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:18.294378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3daba7-cbfa-4672-aabe-08ab0cbdbf08 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:18.327767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:18.328420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:18.328706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:18.328983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:18.339331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:18.340823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 09:36:18.355686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:18.356866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 09:36:18.357952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 09:36:18.357952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 09:36:18.357952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:18.357952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 650/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:18.362452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4edff-a9dd-4b28-b135-9227c065f4a9 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:18.457757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4edff-a9dd-4b28-b135-9227c065f4a9 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:18.491389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:18.491993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:18.492378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:18.492655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:18.493288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:18.493586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:18.494925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:18.505618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 634/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Wed Aug 31 09:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:18.511751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:18.609620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e9c09-172e-452d-a28a-bd8f651287a4 None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:18.622477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:18.642603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:18.643214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:18.643505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:18.643771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:18.650787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:18.652260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 09:36:18.663261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:18.664409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: ERROR keystone.server.flask.application Aug 31 09:36:18.665344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 651/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Wed Aug 31 09:36:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:18.670362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:18.719733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:18.772066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76875-5a0c-4a16-8393-4eac5f1f3a4d None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:18.805497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418a96b-ac18-48f7-aadd-6f708dca9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:18.806096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a96b-ac18-48f7-aadd-6f708dca9fab None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:18.806383 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a96b-ac18-48f7-aadd-6f708dca9fab None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:18.806652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418a96b-ac18-48f7-aadd-6f708dca9fab None admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:18.807340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418a96b-ac18-48f7-aadd-6f708dca9fab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:18.807640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418a96b-ac18-48f7-aadd-6f708dca9fab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:18.809088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4418a96b-ac18-48f7-aadd-6f708dca9fab None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:18.821271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 635/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Wed Aug 31 09:36:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:18.827402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:18.923783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b7cdf-8b0d-4225-ab83-f2ad3cb777ce None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:18.957274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540110b-7e76-4135-b6fb-42b890e6a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:18.957860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540110b-7e76-4135-b6fb-42b890e6a457 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:18.958140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540110b-7e76-4135-b6fb-42b890e6a457 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:18.958412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540110b-7e76-4135-b6fb-42b890e6a457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:18.959126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540110b-7e76-4135-b6fb-42b890e6a457 None admin] RBAC: Adding query filter params (role.id=efaaf0cd59694f50947c6a026ec9fdbf, scope.project.id=2bf987a0692345ed85d0121efd2c30c6, user.id=55fa039431004ca19da7c95ad6f428a4) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:18.959430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540110b-7e76-4135-b6fb-42b890e6a457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:18.960925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8540110b-7e76-4135-b6fb-42b890e6a457 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:18.966471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 652/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Wed Aug 31 09:36:18 2022] GET /identity/v3/role_assignments?user.id=55fa039431004ca19da7c95ad6f428a4&scope.project.id=2bf987a0692345ed85d0121efd2c30c6&role.id=efaaf0cd59694f50947c6a026ec9fdbf => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:20.876845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad25e70-4afb-4094-aca4-2e71216b630d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:20.877377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad25e70-4afb-4094-aca4-2e71216b630d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:20.877377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad25e70-4afb-4094-aca4-2e71216b630d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:20.878716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 636/1288] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:36:20.884018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133db614-c058-4a1d-85d7-f27c74ba8207 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:20.884464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133db614-c058-4a1d-85d7-f27c74ba8207 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:20.884611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133db614-c058-4a1d-85d7-f27c74ba8207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:20.902486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-133db614-c058-4a1d-85d7-f27c74ba8207 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:36:20.903667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-133db614-c058-4a1d-85d7-f27c74ba8207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:36:20.934303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:20.971186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 653/1289] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:36:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:36:21.249100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad25e70-4afb-4094-aca4-2e71216b630d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:21.348276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad25e70-4afb-4094-aca4-2e71216b630d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:21.359227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:21.382357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:21.382986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:21.383258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:21.383529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:21.384098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:21.385511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:21.394079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:21.395310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:21.396234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 637/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:36:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:21.401678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133db614-c058-4a1d-85d7-f27c74ba8207 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:21.499617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133db614-c058-4a1d-85d7-f27c74ba8207 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:21.533280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae02141-7da6-49c0-a2f5-51bd0434be22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:21.533878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae02141-7da6-49c0-a2f5-51bd0434be22 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:21.534158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae02141-7da6-49c0-a2f5-51bd0434be22 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:21.534433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae02141-7da6-49c0-a2f5-51bd0434be22 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:21.535050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae02141-7da6-49c0-a2f5-51bd0434be22 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:21.535349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae02141-7da6-49c0-a2f5-51bd0434be22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:21.536748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae02141-7da6-49c0-a2f5-51bd0434be22 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:21.541648 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 654/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 31 09:36:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:21.547709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:21.644900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c33f-bada-4fe1-a974-1624d497770c None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:21.677722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69898a6-2cfb-4d3a-a721-068a8d7afa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:21.678315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69898a6-2cfb-4d3a-a721-068a8d7afa95 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:21.678597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69898a6-2cfb-4d3a-a721-068a8d7afa95 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:21.678869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69898a6-2cfb-4d3a-a721-068a8d7afa95 None admin] PATH_INFO: `/v3/services` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:21.679554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69898a6-2cfb-4d3a-a721-068a8d7afa95 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:21.679858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69898a6-2cfb-4d3a-a721-068a8d7afa95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:21.681254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69898a6-2cfb-4d3a-a721-068a8d7afa95 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:21.685584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 638/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 31 09:36:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:23.557484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb1cbe-c84b-4bf6-bd6e-1d047e6403ee None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:23.558055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb1cbe-c84b-4bf6-bd6e-1d047e6403ee None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:23.558055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb1cbe-c84b-4bf6-bd6e-1d047e6403ee None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:23.559356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 655/1293] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:36:23.564429 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819357-d514-48dd-8a56-3bd7b2714515 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:23.564865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819357-d514-48dd-8a56-3bd7b2714515 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:23.564999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b819357-d514-48dd-8a56-3bd7b2714515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:23.583263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8b819357-d514-48dd-8a56-3bd7b2714515 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:36:23.584457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8b819357-d514-48dd-8a56-3bd7b2714515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:36:23.612586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:23.649844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 639/1294] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:36:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:36:23.921453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb1cbe-c84b-4bf6-bd6e-1d047e6403ee None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:23.952739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:24.032327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb1cbe-c84b-4bf6-bd6e-1d047e6403ee None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:24.070846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8893cb-7a48-42df-a36e-db3468625ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:24.071443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8893cb-7a48-42df-a36e-db3468625ca8 None admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:24.071722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8893cb-7a48-42df-a36e-db3468625ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:24.071994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8893cb-7a48-42df-a36e-db3468625ca8 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:24.072666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8893cb-7a48-42df-a36e-db3468625ca8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:24.074031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8893cb-7a48-42df-a36e-db3468625ca8 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:24.087387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 656/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Wed Aug 31 09:36:23 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:36:25.984640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fee5ca-1f26-4ee1-82c7-493823a6db00 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:25.985204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fee5ca-1f26-4ee1-82c7-493823a6db00 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:25.985204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fee5ca-1f26-4ee1-82c7-493823a6db00 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:25.986723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 640/1296] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:36:25.993198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1589-6f12-4a6f-a81a-766008be2897 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:25.993650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1589-6f12-4a6f-a81a-766008be2897 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:25.993778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c1589-6f12-4a6f-a81a-766008be2897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:26.012588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-fe1c1589-6f12-4a6f-a81a-766008be2897 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:36:26.013786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fe1c1589-6f12-4a6f-a81a-766008be2897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:36:26.084027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 657/1297] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:36:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 09:36:26.356854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fee5ca-1f26-4ee1-82c7-493823a6db00 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:26.463376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fee5ca-1f26-4ee1-82c7-493823a6db00 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:26.496600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:26.497219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:26.497498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:26.497766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:26.498339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:26.499706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:26.508469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:26.509645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:26.510697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 641/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:36:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:26.515564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1589-6f12-4a6f-a81a-766008be2897 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:26.533840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:26.612532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c1589-6f12-4a6f-a81a-766008be2897 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:26.644470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:26.645058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:26.645337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:26.645610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:26.646226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] RBAC: Adding query filter params (name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:26.646527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:26.647890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:26.653634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 658/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 31 09:36:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:26.659471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:26.692375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:26.759747 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4aeb52-c9f3-4957-b502-c92ae43a02d0 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:26.793755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b504da-95a8-4283-b8d0-81d77d54670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:26.794353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b504da-95a8-4283-b8d0-81d77d54670a None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:26.794631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b504da-95a8-4283-b8d0-81d77d54670a None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:26.794898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b504da-95a8-4283-b8d0-81d77d54670a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:26.795592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b504da-95a8-4283-b8d0-81d77d54670a None admin] RBAC: Adding query filter params (interface=public, service_id=6f1533d1289a4e03987a2e4f9c4105ba, region_id=RegionOne) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:26.795892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b504da-95a8-4283-b8d0-81d77d54670a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:26.797534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b504da-95a8-4283-b8d0-81d77d54670a None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:26.802338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 642/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Wed Aug 31 09:36:26 2022] GET /identity/v3/endpoints?service_id=6f1533d1289a4e03987a2e4f9c4105ba&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:26.808155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:26.887920 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:26.906756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c3716-9c31-424f-b70c-055eba42130a None admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:26.940092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301afdc8-8093-4397-8ab9-21e187363f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:26.940716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afdc8-8093-4397-8ab9-21e187363f10 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:26.941000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afdc8-8093-4397-8ab9-21e187363f10 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:26.941277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301afdc8-8093-4397-8ab9-21e187363f10 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:26.941877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301afdc8-8093-4397-8ab9-21e187363f10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:26.943244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301afdc8-8093-4397-8ab9-21e187363f10 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:26.949886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 659/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Wed Aug 31 09:36:26 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:36:28.873254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e370-36d2-4c90-bcb6-a25ff8be8182 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:28.873800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e370-36d2-4c90-bcb6-a25ff8be8182 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:28.873800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c254e370-36d2-4c90-bcb6-a25ff8be8182 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:28.875137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 643/1302] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:36:28.880221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f54c-63cf-408d-83ed-339f7181ce52 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:28.880598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f54c-63cf-408d-83ed-339f7181ce52 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:28.880788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5f54c-63cf-408d-83ed-339f7181ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:28.899382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a1a5f54c-63cf-408d-83ed-339f7181ce52 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:36:28.900605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a1a5f54c-63cf-408d-83ed-339f7181ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:36:28.967391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 660/1303] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:36:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 09:36:29.264097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254e370-36d2-4c90-bcb6-a25ff8be8182 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:29.357649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:29.364368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c254e370-36d2-4c90-bcb6-a25ff8be8182 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:29.396524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:29.397136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:29.397413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:29.397681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:29.398766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:29.400104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 09:36:29.408666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 09:36:29.409815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application with Lock( Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self._enter() Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application return self.creator() Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application created_value = creator( Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: ERROR keystone.server.flask.application Aug 31 09:36:29.410654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 644/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Wed Aug 31 09:36:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 09:36:29.416532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f54c-63cf-408d-83ed-339f7181ce52 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:29.495698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:29.518807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5f54c-63cf-408d-83ed-339f7181ce52 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:29.552219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98128e43-cf40-4ef1-94af-0be2851c7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:29.552810 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128e43-cf40-4ef1-94af-0be2851c7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:29.553090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128e43-cf40-4ef1-94af-0be2851c7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:29.553363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98128e43-cf40-4ef1-94af-0be2851c7ff3 None admin] PATH_INFO: `/v3/services` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:29.553979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98128e43-cf40-4ef1-94af-0be2851c7ff3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:36:29.554306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98128e43-cf40-4ef1-94af-0be2851c7ff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:29.555676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98128e43-cf40-4ef1-94af-0be2851c7ff3 None admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:29.560590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 661/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Wed Aug 31 09:36:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:36:29.566515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:36:29.664393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488c9a0-f63e-4e5e-9421-583c21430112 None admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:36:29.697529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d780d8-14eb-4e38-a808-d2c70a0c8497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:36:29.698126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d780d8-14eb-4e38-a808-d2c70a0c8497 None admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:36:29.698405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d780d8-14eb-4e38-a808-d2c70a0c8497 None admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:36:29.698674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d780d8-14eb-4e38-a808-d2c70a0c8497 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:36:29.699331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d780d8-14eb-4e38-a808-d2c70a0c8497 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:36:29.700723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d780d8-14eb-4e38-a808-d2c70a0c8497 None admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:36:29.719922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 645/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:36:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:36:39.557693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=30 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:36:39.715497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:33.695916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfdd7-b226-486b-aae7-043f639cfdd8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:33.697016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfdd7-b226-486b-aae7-043f639cfdd8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:33.697514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cfdd7-b226-486b-aae7-043f639cfdd8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:33.704381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad212-4755-4200-b415-ac57f6d27dbd None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:33.705215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad212-4755-4200-b415-ac57f6d27dbd None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:33.705709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ad212-4755-4200-b415-ac57f6d27dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:33.710734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 662/1307] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:33 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:33.802401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8e7ad212-4755-4200-b415-ac57f6d27dbd None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:33.805125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8e7ad212-4755-4200-b415-ac57f6d27dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:33.932142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 646/1308] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:37:34.254560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f0a9f-693e-4d20-b4d9-ccf97d297d9b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:34.255205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f0a9f-693e-4d20-b4d9-ccf97d297d9b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:34.255786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f0a9f-693e-4d20-b4d9-ccf97d297d9b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:34.259125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 663/1309] 10.222.0.18 () {54 vars in 965 bytes} [Wed Aug 31 09:37:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:34.267748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc5944-ce74-4ce5-9ec7-a4fdaa6cd106 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:34.268024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc5944-ce74-4ce5-9ec7-a4fdaa6cd106 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:34.268427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc5944-ce74-4ce5-9ec7-a4fdaa6cd106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:34.352243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d2bc5944-ce74-4ce5-9ec7-a4fdaa6cd106 None None] MFA Rules not processed for user `886e718c9d7d48aa8655b8993e2af945`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:34.353493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d2bc5944-ce74-4ce5-9ec7-a4fdaa6cd106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:34.376020 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:34.446677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 647/1310] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Aug 31 09:37:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:34.457745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f0a9f-693e-4d20-b4d9-ccf97d297d9b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:34.462213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-653f0a9f-693e-4d20-b4d9-ccf97d297d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:34.590108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f0a9f-693e-4d20-b4d9-ccf97d297d9b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:34.671882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a1a62-b671-43c8-9f80-cfe6bae9188b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:34.672471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1a62-b671-43c8-9f80-cfe6bae9188b service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:34.672749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1a62-b671-43c8-9f80-cfe6bae9188b service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:34.673023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a1a62-b671-43c8-9f80-cfe6bae9188b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:34.674662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-655a1a62-b671-43c8-9f80-cfe6bae9188b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:34.740664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:34.805050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a1a62-b671-43c8-9f80-cfe6bae9188b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:34.806549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a1a62-b671-43c8-9f80-cfe6bae9188b service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:34.828529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 664/1311] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:37:37.036338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34775701-a01c-4fc4-9167-9f1a44eb6326 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:37.036869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34775701-a01c-4fc4-9167-9f1a44eb6326 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:37.036869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34775701-a01c-4fc4-9167-9f1a44eb6326 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:37.039069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 648/1312] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:37.044116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ac6-0fd8-4448-93b3-9d8eca90b380 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:37.044570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ac6-0fd8-4448-93b3-9d8eca90b380 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:37.044682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788ac6-0fd8-4448-93b3-9d8eca90b380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:37.138378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-d6788ac6-0fd8-4448-93b3-9d8eca90b380 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:37.139920 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d6788ac6-0fd8-4448-93b3-9d8eca90b380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:37.259809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 665/1313] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:37.546673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34775701-a01c-4fc4-9167-9f1a44eb6326 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:37.548545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-34775701-a01c-4fc4-9167-9f1a44eb6326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:37.664666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34775701-a01c-4fc4-9167-9f1a44eb6326 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:37.737317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:37.739742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c26802-4498-4170-9ff8-de4197e501d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:37.740325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c26802-4498-4170-9ff8-de4197e501d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:37.740880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c26802-4498-4170-9ff8-de4197e501d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:37.741179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c26802-4498-4170-9ff8-de4197e501d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:37.743274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-81c26802-4498-4170-9ff8-de4197e501d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:37.854203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c26802-4498-4170-9ff8-de4197e501d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:37.855651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c26802-4498-4170-9ff8-de4197e501d7 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:37.874152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 649/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:37:40.076022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551a1e-f678-4c05-aa21-858c14143de7 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:40.076642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551a1e-f678-4c05-aa21-858c14143de7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:40.076642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd551a1e-f678-4c05-aa21-858c14143de7 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:40.078033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 666/1315] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:40.083240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09b5f1-418a-4aff-98e6-b98d94d4ed38 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:40.083681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09b5f1-418a-4aff-98e6-b98d94d4ed38 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:40.083787 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee09b5f1-418a-4aff-98e6-b98d94d4ed38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:40.151378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ee09b5f1-418a-4aff-98e6-b98d94d4ed38 None None] MFA Rules not processed for user `ece3258dc3b7408eb33f44129658af4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:40.152694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ee09b5f1-418a-4aff-98e6-b98d94d4ed38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:40.203835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:40.249030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 650/1316] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:40 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:40.534120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd551a1e-f678-4c05-aa21-858c14143de7 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:40.535667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fd551a1e-f678-4c05-aa21-858c14143de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:40.546363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:40.642833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd551a1e-f678-4c05-aa21-858c14143de7 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:40.716269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e76b28-9a49-4833-ac8c-eaa8024a9d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:40.716867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e76b28-9a49-4833-ac8c-eaa8024a9d7f service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:40.717142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e76b28-9a49-4833-ac8c-eaa8024a9d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:40.717406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e76b28-9a49-4833-ac8c-eaa8024a9d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:40.719002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f2e76b28-9a49-4833-ac8c-eaa8024a9d7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:40.785417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:40.832597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e76b28-9a49-4833-ac8c-eaa8024a9d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:40.834056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e76b28-9a49-4833-ac8c-eaa8024a9d7f service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:40.853716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 667/1317] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:37:43.315316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c509e8-aa6c-4e2c-b725-d149c7565d36 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:43.315858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c509e8-aa6c-4e2c-b725-d149c7565d36 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:43.315858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c509e8-aa6c-4e2c-b725-d149c7565d36 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:43.317233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 651/1318] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:43.322468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ff54-77a2-4657-babb-50ea2909fca0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:43.322880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ff54-77a2-4657-babb-50ea2909fca0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:43.323024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381ff54-77a2-4657-babb-50ea2909fca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:43.388130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f381ff54-77a2-4657-babb-50ea2909fca0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:43.389421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f381ff54-77a2-4657-babb-50ea2909fca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:43.485658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 668/1319] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:43.772589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c509e8-aa6c-4e2c-b725-d149c7565d36 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:43.774147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-18c509e8-aa6c-4e2c-b725-d149c7565d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:43.875687 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c509e8-aa6c-4e2c-b725-d149c7565d36 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:43.948458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9465c-3b22-4a72-8949-19d76338dcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:43.949060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9465c-3b22-4a72-8949-19d76338dcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:43.949339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9465c-3b22-4a72-8949-19d76338dcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:43.949608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9465c-3b22-4a72-8949-19d76338dcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:43.951181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5ca9465c-3b22-4a72-8949-19d76338dcc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:43.958511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:44.061393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9465c-3b22-4a72-8949-19d76338dcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:44.062733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9465c-3b22-4a72-8949-19d76338dcc2 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:44.082539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 652/1320] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:37:46.626838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e00a-8c9e-48ed-ace3-c4ae85438121 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:46.627472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e00a-8c9e-48ed-ace3-c4ae85438121 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:46.627472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98e00a-8c9e-48ed-ace3-c4ae85438121 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:46.628911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 669/1321] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:46.634548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62511d4-d4d9-42db-a569-b5754981692d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:46.634971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62511d4-d4d9-42db-a569-b5754981692d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:46.635230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62511d4-d4d9-42db-a569-b5754981692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:46.710841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c62511d4-d4d9-42db-a569-b5754981692d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:46.712070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c62511d4-d4d9-42db-a569-b5754981692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:46.772727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:46.813549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 653/1322] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:47.105171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98e00a-8c9e-48ed-ace3-c4ae85438121 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:47.106720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4e98e00a-8c9e-48ed-ace3-c4ae85438121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:47.125902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:47.211637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98e00a-8c9e-48ed-ace3-c4ae85438121 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:47.282942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea7765-8d05-4aef-ada2-0704343cb490 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:47.283541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7765-8d05-4aef-ada2-0704343cb490 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:47.283820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7765-8d05-4aef-ada2-0704343cb490 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:47.284092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea7765-8d05-4aef-ada2-0704343cb490 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:47.285698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f4ea7765-8d05-4aef-ada2-0704343cb490 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:47.358112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:47.402760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea7765-8d05-4aef-ada2-0704343cb490 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:47.404334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea7765-8d05-4aef-ada2-0704343cb490 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:47.428312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 670/1323] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:37:49.417553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8eac-2c31-499c-875d-f0f4c1dda268 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:49.418077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8eac-2c31-499c-875d-f0f4c1dda268 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:49.418077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8eac-2c31-499c-875d-f0f4c1dda268 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:49.419457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 654/1324] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:49.425039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f8068-78e6-4eb3-b9ac-6fc48d7e945b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:49.425480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f8068-78e6-4eb3-b9ac-6fc48d7e945b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:49.425585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f8068-78e6-4eb3-b9ac-6fc48d7e945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:49.493075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-781f8068-78e6-4eb3-b9ac-6fc48d7e945b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:49.494297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-781f8068-78e6-4eb3-b9ac-6fc48d7e945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:49.596733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 671/1325] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:49.909620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32f50b-3c5d-440f-aa93-cd3d4fc6f5e1 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:49.909933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32f50b-3c5d-440f-aa93-cd3d4fc6f5e1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:49.910208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32f50b-3c5d-440f-aa93-cd3d4fc6f5e1 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:49.911551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 655/1326] 10.222.0.18 () {54 vars in 965 bytes} [Wed Aug 31 09:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:49.917740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca2d7-5f0c-4cec-86fd-d3b0196810f0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:49.918096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca2d7-5f0c-4cec-86fd-d3b0196810f0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:49.918381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fca2d7-5f0c-4cec-86fd-d3b0196810f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:49.950577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:50.003491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-98fca2d7-5f0c-4cec-86fd-d3b0196810f0 None None] MFA Rules not processed for user `886e718c9d7d48aa8655b8993e2af945`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:50.004761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-98fca2d7-5f0c-4cec-86fd-d3b0196810f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:50.083285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 672/1327] 10.222.0.18 () {58 vars in 1062 bytes} [Wed Aug 31 09:37:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:37:50.092999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32f50b-3c5d-440f-aa93-cd3d4fc6f5e1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:50.094573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3c32f50b-3c5d-440f-aa93-cd3d4fc6f5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:50.196702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32f50b-3c5d-440f-aa93-cd3d4fc6f5e1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:50.268969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113f5f9-e018-4b9b-98c0-8070258fa881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:50.269536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f5f9-e018-4b9b-98c0-8070258fa881 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:50.269770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f5f9-e018-4b9b-98c0-8070258fa881 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:50.270038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113f5f9-e018-4b9b-98c0-8070258fa881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:50.271605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b113f5f9-e018-4b9b-98c0-8070258fa881 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:50.288929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:50.382528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113f5f9-e018-4b9b-98c0-8070258fa881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:50.383974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113f5f9-e018-4b9b-98c0-8070258fa881 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:50.402726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 656/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:37:52.602589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150df7d-c3c1-48b9-975e-9b9f597c6a7a None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:52.602589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150df7d-c3c1-48b9-975e-9b9f597c6a7a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:52.602589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150df7d-c3c1-48b9-975e-9b9f597c6a7a None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:52.608389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 673/1329] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:52.610235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1237c-4570-4cfb-ba13-9b5e50244eab None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:52.611051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1237c-4570-4cfb-ba13-9b5e50244eab None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:52.611539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1237c-4570-4cfb-ba13-9b5e50244eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:52.691874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-18a1237c-4570-4cfb-ba13-9b5e50244eab None None] MFA Rules not processed for user `ece3258dc3b7408eb33f44129658af4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:52.693064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-18a1237c-4570-4cfb-ba13-9b5e50244eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:52.762781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:52.796025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 657/1330] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:53.081691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150df7d-c3c1-48b9-975e-9b9f597c6a7a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:53.083219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1150df7d-c3c1-48b9-975e-9b9f597c6a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:53.187937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150df7d-c3c1-48b9-975e-9b9f597c6a7a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:53.208933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:53.268751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20930093-c5f1-417d-8718-c75e77f81b18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:53.269372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20930093-c5f1-417d-8718-c75e77f81b18 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:53.269655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20930093-c5f1-417d-8718-c75e77f81b18 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:53.269938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20930093-c5f1-417d-8718-c75e77f81b18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:53.271567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-20930093-c5f1-417d-8718-c75e77f81b18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:53.387052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20930093-c5f1-417d-8718-c75e77f81b18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:53.388546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20930093-c5f1-417d-8718-c75e77f81b18 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:53.408478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 674/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:37:55.727358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab067fba-dae6-40b0-b3df-a7722e0340e8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:55.727802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab067fba-dae6-40b0-b3df-a7722e0340e8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:55.727897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab067fba-dae6-40b0-b3df-a7722e0340e8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:55.729274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 658/1332] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:55.734722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cd743-10aa-4506-9f33-af14e5d45bcb None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:55.735154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cd743-10aa-4506-9f33-af14e5d45bcb None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:55.735423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cd743-10aa-4506-9f33-af14e5d45bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:55.802308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:55.805841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4a6cd743-10aa-4506-9f33-af14e5d45bcb None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:55.807657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4a6cd743-10aa-4506-9f33-af14e5d45bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:55.904117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 675/1333] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:56.194259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab067fba-dae6-40b0-b3df-a7722e0340e8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:56.195943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ab067fba-dae6-40b0-b3df-a7722e0340e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:56.298376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab067fba-dae6-40b0-b3df-a7722e0340e8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:56.372424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807f611-54ca-4e39-b41a-5a44f436c55f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:56.373032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f611-54ca-4e39-b41a-5a44f436c55f service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:56.373861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f611-54ca-4e39-b41a-5a44f436c55f service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:56.374145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f611-54ca-4e39-b41a-5a44f436c55f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:56.375754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3807f611-54ca-4e39-b41a-5a44f436c55f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:56.402714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:56.485920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807f611-54ca-4e39-b41a-5a44f436c55f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:56.487274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807f611-54ca-4e39-b41a-5a44f436c55f service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:56.505069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 659/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:37:58.433434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad1b7b-780e-41fa-a9fb-ab85360fae5f None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:58.434042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad1b7b-780e-41fa-a9fb-ab85360fae5f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:58.434042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad1b7b-780e-41fa-a9fb-ab85360fae5f None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:58.435337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 676/1335] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:37:58.440358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bba32e-c2a5-4b0a-8678-c56e82fe1cde None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:58.440794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bba32e-c2a5-4b0a-8678-c56e82fe1cde None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:58.440890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bba32e-c2a5-4b0a-8678-c56e82fe1cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:58.505461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-93bba32e-c2a5-4b0a-8678-c56e82fe1cde None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:37:58.506714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-93bba32e-c2a5-4b0a-8678-c56e82fe1cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:58.582624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:58.607794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 660/1336] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:37:58.893197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad1b7b-780e-41fa-a9fb-ab85360fae5f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:37:58.894713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e7ad1b7b-780e-41fa-a9fb-ab85360fae5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:58.996793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad1b7b-780e-41fa-a9fb-ab85360fae5f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:37:59.024613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:37:59.071247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb3f20-70a5-4d34-bef9-a3cd507ae03a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:37:59.071847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3f20-70a5-4d34-bef9-a3cd507ae03a service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:37:59.072125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3f20-70a5-4d34-bef9-a3cd507ae03a service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:37:59.072428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb3f20-70a5-4d34-bef9-a3cd507ae03a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:37:59.074024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e9fb3f20-70a5-4d34-bef9-a3cd507ae03a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:37:59.183098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb3f20-70a5-4d34-bef9-a3cd507ae03a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:37:59.184571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb3f20-70a5-4d34-bef9-a3cd507ae03a service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:37:59.202643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 677/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:01.555538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4cd0b-6b7b-4ccb-b122-59ea1f4a2dfe None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:01.556079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4cd0b-6b7b-4ccb-b122-59ea1f4a2dfe None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:01.556079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4cd0b-6b7b-4ccb-b122-59ea1f4a2dfe None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:01.557563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 661/1338] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:01.562744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaca7-0e5e-4d2b-a9fb-d967c695891c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:01.563160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaca7-0e5e-4d2b-a9fb-d967c695891c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:01.563296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808eaca7-0e5e-4d2b-a9fb-d967c695891c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:01.630353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-808eaca7-0e5e-4d2b-a9fb-d967c695891c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:01.631588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-808eaca7-0e5e-4d2b-a9fb-d967c695891c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:01.639890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:01.729890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 678/1339] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:02.008803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4cd0b-6b7b-4ccb-b122-59ea1f4a2dfe None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:02.010372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d7f4cd0b-6b7b-4ccb-b122-59ea1f4a2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:02.114531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4cd0b-6b7b-4ccb-b122-59ea1f4a2dfe None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:02.186374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1cbd4-3d77-4e5b-b92c-9d489e1c22d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:02.186976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1cbd4-3d77-4e5b-b92c-9d489e1c22d3 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:02.187248 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1cbd4-3d77-4e5b-b92c-9d489e1c22d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:02.187514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1cbd4-3d77-4e5b-b92c-9d489e1c22d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:02.189110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fef1cbd4-3d77-4e5b-b92c-9d489e1c22d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:02.224052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:02.297007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1cbd4-3d77-4e5b-b92c-9d489e1c22d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:02.298363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1cbd4-3d77-4e5b-b92c-9d489e1c22d3 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:02.316428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 662/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:06.252396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef07df-e532-4847-850a-e3fdd5304568 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:06.252905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef07df-e532-4847-850a-e3fdd5304568 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:06.252983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef07df-e532-4847-850a-e3fdd5304568 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:06.254326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 679/1341] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:06.260298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c6101-bb00-4195-bfce-b51698e44cc9 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:06.260718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c6101-bb00-4195-bfce-b51698e44cc9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:06.260907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c6101-bb00-4195-bfce-b51698e44cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:06.328875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6a9c6101-bb00-4195-bfce-b51698e44cc9 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:06.330066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6a9c6101-bb00-4195-bfce-b51698e44cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:06.417286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:06.429110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 663/1342] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:06.715138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef07df-e532-4847-850a-e3fdd5304568 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:06.716704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0cef07df-e532-4847-850a-e3fdd5304568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:06.822451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef07df-e532-4847-850a-e3fdd5304568 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:06.859646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:06.896281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d5daf-dae1-4ff8-82dc-c4fab5123d00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:06.896887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5daf-dae1-4ff8-82dc-c4fab5123d00 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:06.897203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5daf-dae1-4ff8-82dc-c4fab5123d00 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:06.897473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d5daf-dae1-4ff8-82dc-c4fab5123d00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:06.899056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-257d5daf-dae1-4ff8-82dc-c4fab5123d00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:07.009638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5daf-dae1-4ff8-82dc-c4fab5123d00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:07.011020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d5daf-dae1-4ff8-82dc-c4fab5123d00 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:07.029733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 680/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:09.643433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308bded-d541-466c-86ff-28fdf5429ffc None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:09.643970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308bded-d541-466c-86ff-28fdf5429ffc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:09.643970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308bded-d541-466c-86ff-28fdf5429ffc None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:09.645360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 664/1344] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:09.651038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f92ea-5682-4c8f-a107-f47e3716a22f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:09.651476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f92ea-5682-4c8f-a107-f47e3716a22f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:09.651804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f92ea-5682-4c8f-a107-f47e3716a22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:09.726162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-993f92ea-5682-4c8f-a107-f47e3716a22f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:09.727382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-993f92ea-5682-4c8f-a107-f47e3716a22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:09.746637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:09.829820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 681/1345] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:38:10.128052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308bded-d541-466c-86ff-28fdf5429ffc None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:10.129686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8308bded-d541-466c-86ff-28fdf5429ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:10.237756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308bded-d541-466c-86ff-28fdf5429ffc None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:10.315768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b507e5-9680-4ac4-9aad-25e7bb2898e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:10.316403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b507e5-9680-4ac4-9aad-25e7bb2898e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:10.316712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b507e5-9680-4ac4-9aad-25e7bb2898e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:10.316984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b507e5-9680-4ac4-9aad-25e7bb2898e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:10.318592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d7b507e5-9680-4ac4-9aad-25e7bb2898e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:10.362542 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:10.430369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b507e5-9680-4ac4-9aad-25e7bb2898e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:10.431711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b507e5-9680-4ac4-9aad-25e7bb2898e9 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:10.449807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 665/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:14.329535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243d885-5a5d-4566-9e20-3b9c6f9b634b None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:14.330062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243d885-5a5d-4566-9e20-3b9c6f9b634b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:14.330062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243d885-5a5d-4566-9e20-3b9c6f9b634b None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:14.331426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 682/1347] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:14.339107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac11a1-2043-42d4-8c08-fb39b2020d16 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:14.339538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac11a1-2043-42d4-8c08-fb39b2020d16 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:14.339632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac11a1-2043-42d4-8c08-fb39b2020d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:14.410127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-46ac11a1-2043-42d4-8c08-fb39b2020d16 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:14.411343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-46ac11a1-2043-42d4-8c08-fb39b2020d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:14.523662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:14.526359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 666/1348] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:14.812541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243d885-5a5d-4566-9e20-3b9c6f9b634b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:14.814564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6243d885-5a5d-4566-9e20-3b9c6f9b634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:14.924252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243d885-5a5d-4566-9e20-3b9c6f9b634b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:14.975269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:15.003062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652eb30-5863-40f5-8ed5-9020762f5c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:15.003668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652eb30-5863-40f5-8ed5-9020762f5c56 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:15.003945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652eb30-5863-40f5-8ed5-9020762f5c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:15.004249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652eb30-5863-40f5-8ed5-9020762f5c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:15.005824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e652eb30-5863-40f5-8ed5-9020762f5c56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:15.115682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652eb30-5863-40f5-8ed5-9020762f5c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:15.117714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652eb30-5863-40f5-8ed5-9020762f5c56 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:15.136319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 683/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:20.105157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0e92-82c3-404b-9e90-43dd21d8c98d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:20.105698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0e92-82c3-404b-9e90-43dd21d8c98d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:20.105930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af0e92-82c3-404b-9e90-43dd21d8c98d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:20.108963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 667/1350] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:38:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:20.117374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8dd23-e3d1-43df-a68c-14fad7dd2611 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:20.117874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8dd23-e3d1-43df-a68c-14fad7dd2611 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:20.117976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8dd23-e3d1-43df-a68c-14fad7dd2611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:20.208600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8bc8dd23-e3d1-43df-a68c-14fad7dd2611 None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:20.209980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8bc8dd23-e3d1-43df-a68c-14fad7dd2611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:20.278290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:20.384109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 684/1351] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:38:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:24.731083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c9e0c-b310-4a0a-a31b-69a9c472327d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:24.731899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c9e0c-b310-4a0a-a31b-69a9c472327d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:24.732299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c9e0c-b310-4a0a-a31b-69a9c472327d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:24.733825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 668/1352] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:24.738671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f879fb3-c444-4c4c-a44f-6398b366d782 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:24.739110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f879fb3-c444-4c4c-a44f-6398b366d782 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:24.739432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f879fb3-c444-4c4c-a44f-6398b366d782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:24.822567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7f879fb3-c444-4c4c-a44f-6398b366d782 None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:24.823827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7f879fb3-c444-4c4c-a44f-6398b366d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:24.906533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:24.952495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 685/1353] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:38:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:26.091474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecff4-6d5c-4f89-b8dd-2cbe256963fa None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:26.092005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecff4-6d5c-4f89-b8dd-2cbe256963fa None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:26.092005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ecff4-6d5c-4f89-b8dd-2cbe256963fa None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:26.093455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 669/1354] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:26.098625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5388-aa2f-48f9-ae54-2a202893416d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:26.099027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5388-aa2f-48f9-ae54-2a202893416d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:26.099301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c5388-aa2f-48f9-ae54-2a202893416d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:26.184159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2a3c5388-aa2f-48f9-ae54-2a202893416d None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:26.185394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2a3c5388-aa2f-48f9-ae54-2a202893416d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:26.297185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 686/1355] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:38:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:29.698134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b42bb-f30d-4fb8-b1da-f7b6dff9afbf None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:29.698699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b42bb-f30d-4fb8-b1da-f7b6dff9afbf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:29.698699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b42bb-f30d-4fb8-b1da-f7b6dff9afbf None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:29.699995 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 670/1356] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:29.705386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e6a7-993f-4e91-8caf-6d80445808e9 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:29.705787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e6a7-993f-4e91-8caf-6d80445808e9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:29.705942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3e6a7-993f-4e91-8caf-6d80445808e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:29.750763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:29.789713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bcd3e6a7-993f-4e91-8caf-6d80445808e9 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:29.791012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bcd3e6a7-993f-4e91-8caf-6d80445808e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:29.925207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 687/1357] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:30.254591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f3a3c-6e09-40d8-916f-46eeb4314e96 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:30.255370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f3a3c-6e09-40d8-916f-46eeb4314e96 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:30.255877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f3a3c-6e09-40d8-916f-46eeb4314e96 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:30.258508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 671/1358] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 31 09:38:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:30.265778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cd647-0905-4082-abd8-e9fcdc4bdcd5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:30.266519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cd647-0905-4082-abd8-e9fcdc4bdcd5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:30.266931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647cd647-0905-4082-abd8-e9fcdc4bdcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:30.348366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-647cd647-0905-4082-abd8-e9fcdc4bdcd5 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:30.349729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-647cd647-0905-4082-abd8-e9fcdc4bdcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:30.402665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:30.481028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 688/1359] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 31 09:38:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:30.493126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f3a3c-6e09-40d8-916f-46eeb4314e96 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:30.495726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e14f3a3c-6e09-40d8-916f-46eeb4314e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:30.695147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f3a3c-6e09-40d8-916f-46eeb4314e96 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:30.778924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:30.824404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f45ec0-bdec-41f9-b9cb-2e3bf74b232c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:30.825123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45ec0-bdec-41f9-b9cb-2e3bf74b232c service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:30.825480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45ec0-bdec-41f9-b9cb-2e3bf74b232c service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:30.825831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f45ec0-bdec-41f9-b9cb-2e3bf74b232c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:30.827522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-86f45ec0-bdec-41f9-b9cb-2e3bf74b232c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:30.923969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f45ec0-bdec-41f9-b9cb-2e3bf74b232c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:30.925698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f45ec0-bdec-41f9-b9cb-2e3bf74b232c service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:30.946127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 672/1360] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:33.087152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb844-3aa7-40ec-92aa-ac8426732655 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:33.087681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb844-3aa7-40ec-92aa-ac8426732655 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:33.087681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bb844-3aa7-40ec-92aa-ac8426732655 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:33.089247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 689/1361] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:38:33.094329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3b81f-68ad-4503-ada8-dde4b11c2dca None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:33.094760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3b81f-68ad-4503-ada8-dde4b11c2dca None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:33.094874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3b81f-68ad-4503-ada8-dde4b11c2dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:33.169769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-61d3b81f-68ad-4503-ada8-dde4b11c2dca None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:33.170962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-61d3b81f-68ad-4503-ada8-dde4b11c2dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:33.211925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:33.291249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 673/1362] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:33.588019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bb844-3aa7-40ec-92aa-ac8426732655 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:33.589356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c46bb844-3aa7-40ec-92aa-ac8426732655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:33.760272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bb844-3aa7-40ec-92aa-ac8426732655 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:33.770014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:33.893256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1920dc5-81b6-4ca2-99d3-65e73e1ee7a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:33.893871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920dc5-81b6-4ca2-99d3-65e73e1ee7a6 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:33.894162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920dc5-81b6-4ca2-99d3-65e73e1ee7a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:33.894471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1920dc5-81b6-4ca2-99d3-65e73e1ee7a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:33.896663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e1920dc5-81b6-4ca2-99d3-65e73e1ee7a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:34.003313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1920dc5-81b6-4ca2-99d3-65e73e1ee7a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:34.004980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1920dc5-81b6-4ca2-99d3-65e73e1ee7a6 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:34.025224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 690/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:36.287475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ec9e5-70c4-4c13-a0d4-bdb5a2d5b3cb None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:36.288048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ec9e5-70c4-4c13-a0d4-bdb5a2d5b3cb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:36.288048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ec9e5-70c4-4c13-a0d4-bdb5a2d5b3cb None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:36.289465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 674/1364] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:36.294801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63bb35-1b14-4ee2-a64f-50832cff23d0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:36.295215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63bb35-1b14-4ee2-a64f-50832cff23d0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:36.295379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63bb35-1b14-4ee2-a64f-50832cff23d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:36.312735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:36.368619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-1e63bb35-1b14-4ee2-a64f-50832cff23d0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:36.369839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1e63bb35-1b14-4ee2-a64f-50832cff23d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:36.473154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 691/1365] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:36.763569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e13e-40aa-4584-b492-b4b39add46ae None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:36.763856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e13e-40aa-4584-b492-b4b39add46ae None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:36.764362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4e13e-40aa-4584-b492-b4b39add46ae None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:36.765692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 675/1366] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 31 09:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:36.771663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae49cc-d0d2-4097-8590-dfaf50d7ae4f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:36.771951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae49cc-d0d2-4097-8590-dfaf50d7ae4f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:36.772268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae49cc-d0d2-4097-8590-dfaf50d7ae4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:36.853859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-56ae49cc-d0d2-4097-8590-dfaf50d7ae4f None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:36.855078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-56ae49cc-d0d2-4097-8590-dfaf50d7ae4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:36.894295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:36.983399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 692/1367] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 31 09:38:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:36.991206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4e13e-40aa-4584-b492-b4b39add46ae None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:36.992749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7ab4e13e-40aa-4584-b492-b4b39add46ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:37.153522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4e13e-40aa-4584-b492-b4b39add46ae None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:37.175412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:37.277319 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36f428-3966-4a34-b71e-bb5d3fca9da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:37.277838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f428-3966-4a34-b71e-bb5d3fca9da4 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:37.278117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f428-3966-4a34-b71e-bb5d3fca9da4 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:37.278387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36f428-3966-4a34-b71e-bb5d3fca9da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:37.279976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cd36f428-3966-4a34-b71e-bb5d3fca9da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:37.386579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f428-3966-4a34-b71e-bb5d3fca9da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:37.388216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36f428-3966-4a34-b71e-bb5d3fca9da4 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:37.407160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 676/1368] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:37.954375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec5f98-d5b3-4147-93c1-697027e501d2 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:37.954925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec5f98-d5b3-4147-93c1-697027e501d2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:37.954925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec5f98-d5b3-4147-93c1-697027e501d2 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:37.956442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 693/1369] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:37.961480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810bcb3-bae3-4c52-bc23-da5684b2076d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:37.961768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810bcb3-bae3-4c52-bc23-da5684b2076d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:37.962044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810bcb3-bae3-4c52-bc23-da5684b2076d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:37.995971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:38.034330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b810bcb3-bae3-4c52-bc23-da5684b2076d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:38.036035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b810bcb3-bae3-4c52-bc23-da5684b2076d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:38.138412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 677/1370] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:38.724211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa00c38-6727-41e1-b70a-b0f8b2593343 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:38.724211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa00c38-6727-41e1-b70a-b0f8b2593343 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:38.724211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa00c38-6727-41e1-b70a-b0f8b2593343 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:38.724211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 694/1371] 10.222.0.18 () {54 vars in 964 bytes} [Wed Aug 31 09:38:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:38.727594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5cca-115f-48e8-b9b5-f1877b8b22ac None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:38.728065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5cca-115f-48e8-b9b5-f1877b8b22ac None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:38.728847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d5cca-115f-48e8-b9b5-f1877b8b22ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:38.807386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f58d5cca-115f-48e8-b9b5-f1877b8b22ac None None] MFA Rules not processed for user `1aca2564475e4df98d4aef031d0b4302`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:38.807895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f58d5cca-115f-48e8-b9b5-f1877b8b22ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:38.857123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:38.889081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 678/1372] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Aug 31 09:38:38 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:38:38.896581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa00c38-6727-41e1-b70a-b0f8b2593343 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:38.898858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3fa00c38-6727-41e1-b70a-b0f8b2593343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:39.013218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa00c38-6727-41e1-b70a-b0f8b2593343 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:39.061594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:39.104274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ef8a1-d5a7-4a1d-a8ce-2bcd1f22a358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:39.106117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ef8a1-d5a7-4a1d-a8ce-2bcd1f22a358 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:39.106936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ef8a1-d5a7-4a1d-a8ce-2bcd1f22a358 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:39.108022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ef8a1-d5a7-4a1d-a8ce-2bcd1f22a358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:39.112805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-045ef8a1-d5a7-4a1d-a8ce-2bcd1f22a358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:39.237212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ef8a1-d5a7-4a1d-a8ce-2bcd1f22a358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:39.238719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ef8a1-d5a7-4a1d-a8ce-2bcd1f22a358 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:39.260241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 695/1373] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:39.442951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2a22-5afb-4679-8d8b-75c15b80d83e None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:39.443228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2a22-5afb-4679-8d8b-75c15b80d83e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:39.443509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c2a22-5afb-4679-8d8b-75c15b80d83e None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:39.445639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 679/1374] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:39.451222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9698-4712-43cb-bd15-9f47b7902297 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:39.451626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9698-4712-43cb-bd15-9f47b7902297 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:39.452098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd9698-4712-43cb-bd15-9f47b7902297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:39.525339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bbdd9698-4712-43cb-bd15-9f47b7902297 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:39.526570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bbdd9698-4712-43cb-bd15-9f47b7902297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:39.548493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:39.631359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 696/1375] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:39.921175 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c2a22-5afb-4679-8d8b-75c15b80d83e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:39.922937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5e7c2a22-5afb-4679-8d8b-75c15b80d83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:40.074230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c2a22-5afb-4679-8d8b-75c15b80d83e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:40.125559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:40.188492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44aea0-2b31-43ba-833a-18cddcf0c3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:40.189028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44aea0-2b31-43ba-833a-18cddcf0c3e2 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:40.189307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44aea0-2b31-43ba-833a-18cddcf0c3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:40.189578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44aea0-2b31-43ba-833a-18cddcf0c3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:40.191187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4f44aea0-2b31-43ba-833a-18cddcf0c3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:40.281256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44aea0-2b31-43ba-833a-18cddcf0c3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:40.282866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44aea0-2b31-43ba-833a-18cddcf0c3e2 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:40.302226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 680/1376] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:42.258770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499f808-8a8f-4a25-9498-0929a480d970 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:42.259568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499f808-8a8f-4a25-9498-0929a480d970 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:42.259568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499f808-8a8f-4a25-9498-0929a480d970 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:42.261096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 697/1377] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:42.266841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ed01-4e32-4f0b-b73b-ee758768cac1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:42.267283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ed01-4e32-4f0b-b73b-ee758768cac1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:42.267563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259ed01-4e32-4f0b-b73b-ee758768cac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:42.352622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4259ed01-4e32-4f0b-b73b-ee758768cac1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:42.353850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4259ed01-4e32-4f0b-b73b-ee758768cac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:42.361035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:42.457875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 681/1378] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:42.769455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499f808-8a8f-4a25-9498-0929a480d970 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:42.770887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c499f808-8a8f-4a25-9498-0929a480d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:42.955398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499f808-8a8f-4a25-9498-0929a480d970 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:42.959340 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:43.095103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d7bc4-6e98-4ec7-afde-55f65a7b4f5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:43.095717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7bc4-6e98-4ec7-afde-55f65a7b4f5d service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:43.096001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7bc4-6e98-4ec7-afde-55f65a7b4f5d service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:43.096310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d7bc4-6e98-4ec7-afde-55f65a7b4f5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:43.097899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-350d7bc4-6e98-4ec7-afde-55f65a7b4f5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:43.193248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d7bc4-6e98-4ec7-afde-55f65a7b4f5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:43.195576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d7bc4-6e98-4ec7-afde-55f65a7b4f5d service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:43.214502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 698/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:45.176555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a038d-6588-4ed3-856e-3705f324066c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:45.177080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a038d-6588-4ed3-856e-3705f324066c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:45.177080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a038d-6588-4ed3-856e-3705f324066c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:45.179197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 682/1380] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:45.184407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c55ec4-b009-4d30-865a-ba353d687553 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:45.184827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c55ec4-b009-4d30-865a-ba353d687553 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:45.185018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c55ec4-b009-4d30-865a-ba353d687553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:45.197200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:45.255198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-51c55ec4-b009-4d30-865a-ba353d687553 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:45.256460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-51c55ec4-b009-4d30-865a-ba353d687553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:45.364290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 699/1381] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:45.657120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a038d-6588-4ed3-856e-3705f324066c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:45.659450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cd2a038d-6588-4ed3-856e-3705f324066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:45.822965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:45.834469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a038d-6588-4ed3-856e-3705f324066c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:45.974923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a4aa3-e016-4645-9a1b-25e9e5def574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:45.975705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4aa3-e016-4645-9a1b-25e9e5def574 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:45.976071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4aa3-e016-4645-9a1b-25e9e5def574 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:45.976432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a4aa3-e016-4645-9a1b-25e9e5def574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:45.978074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d34a4aa3-e016-4645-9a1b-25e9e5def574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:46.078637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a4aa3-e016-4645-9a1b-25e9e5def574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:46.080420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34a4aa3-e016-4645-9a1b-25e9e5def574 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:46.092316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:46.102220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 683/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:48.434469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8737-2b9f-4463-a0f9-c9d95ea5c31f None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:48.435105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8737-2b9f-4463-a0f9-c9d95ea5c31f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:48.435213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e8737-2b9f-4463-a0f9-c9d95ea5c31f None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:48.436994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 700/1383] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:48.443256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff389-e0ad-4bea-86ae-20f0ecd90896 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:48.443715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff389-e0ad-4bea-86ae-20f0ecd90896 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:48.443867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aff389-e0ad-4bea-86ae-20f0ecd90896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:48.515641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-46aff389-e0ad-4bea-86ae-20f0ecd90896 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:48.516933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-46aff389-e0ad-4bea-86ae-20f0ecd90896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:48.629544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 684/1384] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:49.045870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e8737-2b9f-4463-a0f9-c9d95ea5c31f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:49.047688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-064e8737-2b9f-4463-a0f9-c9d95ea5c31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:49.137965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:49.205917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e8737-2b9f-4463-a0f9-c9d95ea5c31f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:49.363108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbf119-a8bc-47d8-b033-8c5d0017e2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:49.364124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf119-a8bc-47d8-b033-8c5d0017e2b3 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:49.364572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf119-a8bc-47d8-b033-8c5d0017e2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:49.364923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbf119-a8bc-47d8-b033-8c5d0017e2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:49.367932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b3bbf119-a8bc-47d8-b033-8c5d0017e2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:49.429461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:49.476244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbf119-a8bc-47d8-b033-8c5d0017e2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:49.478079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbf119-a8bc-47d8-b033-8c5d0017e2b3 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:49.498878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 701/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:51.861371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15074b72-6ca7-444f-bf67-313a8295c838 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:51.862136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15074b72-6ca7-444f-bf67-313a8295c838 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:51.862136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15074b72-6ca7-444f-bf67-313a8295c838 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:51.863378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 685/1386] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:38:51.869775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689345c-eecc-412f-904f-3c4691667848 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:51.870396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689345c-eecc-412f-904f-3c4691667848 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:51.870396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7689345c-eecc-412f-904f-3c4691667848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:51.941724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7689345c-eecc-412f-904f-3c4691667848 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:51.943010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7689345c-eecc-412f-904f-3c4691667848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:52.042142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 702/1387] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:52.334796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15074b72-6ca7-444f-bf67-313a8295c838 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:52.336793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-15074b72-6ca7-444f-bf67-313a8295c838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:52.434714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:52.519452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15074b72-6ca7-444f-bf67-313a8295c838 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:52.638304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2677fd-4993-485f-9b57-937f83ddc663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:52.638916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2677fd-4993-485f-9b57-937f83ddc663 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:52.639188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2677fd-4993-485f-9b57-937f83ddc663 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:52.639454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2677fd-4993-485f-9b57-937f83ddc663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:52.641072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-be2677fd-4993-485f-9b57-937f83ddc663 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:52.683512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:52.737740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2677fd-4993-485f-9b57-937f83ddc663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:52.739340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2677fd-4993-485f-9b57-937f83ddc663 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:52.758008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 686/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:54.438772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c972d1e-467a-4add-893c-b5172e6c2ba1 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:54.439420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c972d1e-467a-4add-893c-b5172e6c2ba1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:54.439420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c972d1e-467a-4add-893c-b5172e6c2ba1 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:54.440742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 703/1389] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:54.446784 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f97cd-b55c-43c1-8c39-7284a44567f4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:54.447225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f97cd-b55c-43c1-8c39-7284a44567f4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:54.447369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f97cd-b55c-43c1-8c39-7284a44567f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:54.516205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3f5f97cd-b55c-43c1-8c39-7284a44567f4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:54.517410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3f5f97cd-b55c-43c1-8c39-7284a44567f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:54.616023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 687/1390] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:54.682046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f427a6-cfce-4269-b687-8f1be6057267 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:54.682336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f427a6-cfce-4269-b687-8f1be6057267 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:54.682636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f427a6-cfce-4269-b687-8f1be6057267 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:54.684014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 704/1391] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:54.689342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0767-839c-4689-be18-2a5a16e00140 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:54.689569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0767-839c-4689-be18-2a5a16e00140 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:54.689842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d0767-839c-4689-be18-2a5a16e00140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:54.706024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:54.759268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-121d0767-839c-4689-be18-2a5a16e00140 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:54.760497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-121d0767-839c-4689-be18-2a5a16e00140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:54.858658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 688/1392] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:38:54.926016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f0e25-f7c8-41f9-854b-17df82fe8e54 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:54.926306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f0e25-f7c8-41f9-854b-17df82fe8e54 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:54.926610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f0e25-f7c8-41f9-854b-17df82fe8e54 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:54.927967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 705/1393] 10.222.0.18 () {54 vars in 967 bytes} [Wed Aug 31 09:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:54.933652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d37e-bcec-457a-b5a7-a515f144fdc2 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:54.934003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d37e-bcec-457a-b5a7-a515f144fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:54.934281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8d37e-bcec-457a-b5a7-a515f144fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:55.011544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-22f8d37e-bcec-457a-b5a7-a515f144fdc2 None None] MFA Rules not processed for user `65c0bf4de3a1442c8b856efbfac436fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:55.012693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-22f8d37e-bcec-457a-b5a7-a515f144fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:55.045812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:55.090942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 689/1394] 10.222.0.18 () {58 vars in 1064 bytes} [Wed Aug 31 09:38:54 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:55.098657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f0e25-f7c8-41f9-854b-17df82fe8e54 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:55.100196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d71f0e25-f7c8-41f9-854b-17df82fe8e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:55.131103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:55.148604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8d37e-bcec-457a-b5a7-a515f144fdc2 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:55.149810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-22f8d37e-bcec-457a-b5a7-a515f144fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:55.208377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f0e25-f7c8-41f9-854b-17df82fe8e54 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:55.273355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8d37e-bcec-457a-b5a7-a515f144fdc2 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:55.284282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a12000-9ecf-4cd8-b3db-8c8b9b87076e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c0bf4de3a1442c8b856efbfac436fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:55.284901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12000-9ecf-4cd8-b3db-8c8b9b87076e service glance] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:55.285190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12000-9ecf-4cd8-b3db-8c8b9b87076e service glance] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:55.285578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a12000-9ecf-4cd8-b3db-8c8b9b87076e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:55.287382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a5a12000-9ecf-4cd8-b3db-8c8b9b87076e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:55.338120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:55.367111 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:55.390498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c36600-45fa-4494-b616-cb37fc4a8b19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:55.391112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c36600-45fa-4494-b616-cb37fc4a8b19 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:55.391403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c36600-45fa-4494-b616-cb37fc4a8b19 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:55.391676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c36600-45fa-4494-b616-cb37fc4a8b19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:55.393417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e8c36600-45fa-4494-b616-cb37fc4a8b19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:55.401051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a12000-9ecf-4cd8-b3db-8c8b9b87076e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:55.402514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a12000-9ecf-4cd8-b3db-8c8b9b87076e service glance] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:55.423316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 706/1395] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:38:55.488579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c36600-45fa-4494-b616-cb37fc4a8b19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:55.490171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c36600-45fa-4494-b616-cb37fc4a8b19 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:55.509463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 690/1396] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:38:56.185929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07530c-6733-4bb2-bbea-680ff124d749 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:56.186455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07530c-6733-4bb2-bbea-680ff124d749 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:56.186647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07530c-6733-4bb2-bbea-680ff124d749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:56.254069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-db07530c-6733-4bb2-bbea-680ff124d749 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:56.255369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-db07530c-6733-4bb2-bbea-680ff124d749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:56.342600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 707/1397] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:56.386032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36bad6-4683-44a1-b133-2a21b4f37c53 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:56.386364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36bad6-4683-44a1-b133-2a21b4f37c53 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:56.386635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36bad6-4683-44a1-b133-2a21b4f37c53 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:56.388012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 691/1398] 10.222.0.18 () {54 vars in 943 bytes} [Wed Aug 31 09:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:56.394751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e374e-0163-4046-ae60-b107924ffa00 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:56.395059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e374e-0163-4046-ae60-b107924ffa00 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:56.395342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e374e-0163-4046-ae60-b107924ffa00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:56.453087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:56.474379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b41e374e-0163-4046-ae60-b107924ffa00 None None] MFA Rules not processed for user `cda7a66a7e054a968f8f633762a1c79b`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:56.475686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b41e374e-0163-4046-ae60-b107924ffa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:56.585466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 708/1399] 10.222.0.18 () {58 vars in 1040 bytes} [Wed Aug 31 09:38:56 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:56.594927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36bad6-4683-44a1-b133-2a21b4f37c53 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:56.596479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2f36bad6-4683-44a1-b133-2a21b4f37c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:56.680235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:56.741683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36bad6-4683-44a1-b133-2a21b4f37c53 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:56.849855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a07b69d-aed3-4994-9636-b3a513c864f3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:56.850465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07b69d-aed3-4994-9636-b3a513c864f3 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:56.851326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07b69d-aed3-4994-9636-b3a513c864f3 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:56.851586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a07b69d-aed3-4994-9636-b3a513c864f3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:56.853245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0a07b69d-aed3-4994-9636-b3a513c864f3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:56.912742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:56.936196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07b69d-aed3-4994-9636-b3a513c864f3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:56.937715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a07b69d-aed3-4994-9636-b3a513c864f3 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:56.945646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 692/1400] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:38:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:38:57.502923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9993c-d7e5-4a8c-b5e1-83452c532b58 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:57.503494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9993c-d7e5-4a8c-b5e1-83452c532b58 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:57.503494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9993c-d7e5-4a8c-b5e1-83452c532b58 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:57.508538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 709/1401] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:38:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:38:57.511162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040be5-e717-4cd4-8431-272c91a8920c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:57.511452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040be5-e717-4cd4-8431-272c91a8920c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:57.511728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3040be5-e717-4cd4-8431-272c91a8920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:57.583759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b3040be5-e717-4cd4-8431-272c91a8920c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:38:57.585714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b3040be5-e717-4cd4-8431-272c91a8920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:57.711399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 693/1402] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:38:58.014431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9993c-d7e5-4a8c-b5e1-83452c532b58 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:38:58.016023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4ed9993c-d7e5-4a8c-b5e1-83452c532b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:58.132821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:58.188435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9993c-d7e5-4a8c-b5e1-83452c532b58 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:38:58.314764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e945e7-9371-4c6b-9586-3ef6240461eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:38:58.315374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e945e7-9371-4c6b-9586-3ef6240461eb service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:38:58.315662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e945e7-9371-4c6b-9586-3ef6240461eb service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:38:58.315938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e945e7-9371-4c6b-9586-3ef6240461eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:38:58.317584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-76e945e7-9371-4c6b-9586-3ef6240461eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:38:58.397478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:38:58.419069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e945e7-9371-4c6b-9586-3ef6240461eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:38:58.420829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e945e7-9371-4c6b-9586-3ef6240461eb service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:38:58.442552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 710/1403] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:00.408748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed2d1-f8a2-422e-87ae-a139646a114c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:00.409330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed2d1-f8a2-422e-87ae-a139646a114c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:00.409330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ed2d1-f8a2-422e-87ae-a139646a114c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:00.410673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 694/1404] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:00.416697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2945-0716-48dc-ba16-e31793eb1d80 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:00.417153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2945-0716-48dc-ba16-e31793eb1d80 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:00.417259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2945-0716-48dc-ba16-e31793eb1d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:00.496331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0c4e2945-0716-48dc-ba16-e31793eb1d80 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:00.497834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0c4e2945-0716-48dc-ba16-e31793eb1d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:00.630648 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 711/1405] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:39:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:00.940037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ed2d1-f8a2-422e-87ae-a139646a114c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:00.941583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b10ed2d1-f8a2-422e-87ae-a139646a114c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:01.010540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:01.174433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ed2d1-f8a2-422e-87ae-a139646a114c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:01.299652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f318334-ed6a-4f8f-8b67-41b565cd8d3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:01.300343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f318334-ed6a-4f8f-8b67-41b565cd8d3d service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:01.300621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f318334-ed6a-4f8f-8b67-41b565cd8d3d service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:01.300892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f318334-ed6a-4f8f-8b67-41b565cd8d3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:01.302502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7f318334-ed6a-4f8f-8b67-41b565cd8d3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:01.318669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:01.407207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f318334-ed6a-4f8f-8b67-41b565cd8d3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:01.408851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f318334-ed6a-4f8f-8b67-41b565cd8d3d service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:01.432750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 695/1406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:03.419596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77725a-a548-4b70-9020-06ac20dac59c None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:03.420218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77725a-a548-4b70-9020-06ac20dac59c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:03.420218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77725a-a548-4b70-9020-06ac20dac59c None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:03.424285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 712/1407] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:39:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:03.427307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322c9a-8722-42c7-8a2d-b44c38397143 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:03.427743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322c9a-8722-42c7-8a2d-b44c38397143 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:03.427849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90322c9a-8722-42c7-8a2d-b44c38397143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:03.509911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-90322c9a-8722-42c7-8a2d-b44c38397143 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:03.511230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-90322c9a-8722-42c7-8a2d-b44c38397143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:03.608281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:03.622300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 696/1408] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:03.922432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77725a-a548-4b70-9020-06ac20dac59c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:03.924339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5e77725a-a548-4b70-9020-06ac20dac59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:03.982007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:04.099754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77725a-a548-4b70-9020-06ac20dac59c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:04.225717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a05c3e-4aae-49b9-a2ed-d1db5b8ebb2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:04.226508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05c3e-4aae-49b9-a2ed-d1db5b8ebb2d service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:04.226873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05c3e-4aae-49b9-a2ed-d1db5b8ebb2d service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:04.227219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a05c3e-4aae-49b9-a2ed-d1db5b8ebb2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:04.228977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c3a05c3e-4aae-49b9-a2ed-d1db5b8ebb2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:04.237310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:04.333717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a05c3e-4aae-49b9-a2ed-d1db5b8ebb2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:04.335588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a05c3e-4aae-49b9-a2ed-d1db5b8ebb2d service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:04.354415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 713/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:13.619807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:14.351955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=42 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:19.332289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040f83-ec05-46d9-b576-c78480d1dc8b None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:19.332875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040f83-ec05-46d9-b576-c78480d1dc8b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:19.332875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040f83-ec05-46d9-b576-c78480d1dc8b None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:19.334249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 697/1410] 10.222.0.18 () {54 vars in 918 bytes} [Wed Aug 31 09:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:19.339448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5fc5-ccf7-4acc-a760-a879905ed0fd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:19.339896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5fc5-ccf7-4acc-a760-a879905ed0fd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:19.340015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d5fc5-ccf7-4acc-a760-a879905ed0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:19.414883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3d6d5fc5-ccf7-4acc-a760-a879905ed0fd None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:19.416077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3d6d5fc5-ccf7-4acc-a760-a879905ed0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:19.523859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 714/1411] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 31 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:19.537975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba2373-ae68-492d-9e55-14718003239a None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:19.538260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba2373-ae68-492d-9e55-14718003239a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:19.539085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba2373-ae68-492d-9e55-14718003239a None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:19.540446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 698/1412] 10.222.0.18 () {54 vars in 918 bytes} [Wed Aug 31 09:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:19.545042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293452a-ce5c-42c7-9513-f7df15ea6015 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:19.545334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293452a-ce5c-42c7-9513-f7df15ea6015 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:19.545614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293452a-ce5c-42c7-9513-f7df15ea6015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:19.618808 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:19.621559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5293452a-ce5c-42c7-9513-f7df15ea6015 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:19.623312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5293452a-ce5c-42c7-9513-f7df15ea6015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:19.739640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 715/1413] 10.222.0.18 () {58 vars in 1015 bytes} [Wed Aug 31 09:39:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:22.218671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571189d7-3cb3-49f9-a212-bcd7790c1885 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:22.219200 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571189d7-3cb3-49f9-a212-bcd7790c1885 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:22.219200 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571189d7-3cb3-49f9-a212-bcd7790c1885 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:22.220511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:22.225696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dca63-307f-4c4e-80f5-3e5604856570 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:22.226112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dca63-307f-4c4e-80f5-3e5604856570 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:22.226492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46dca63-307f-4c4e-80f5-3e5604856570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:22.293078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a46dca63-307f-4c4e-80f5-3e5604856570 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:22.294305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a46dca63-307f-4c4e-80f5-3e5604856570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:22.350651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:22.392874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:39:22.685943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571189d7-3cb3-49f9-a212-bcd7790c1885 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:22.687503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-571189d7-3cb3-49f9-a212-bcd7790c1885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:22.834338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571189d7-3cb3-49f9-a212-bcd7790c1885 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:22.906010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:22.947203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0328d-ac32-4a13-8a24-f6910cce4b6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:22.947728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0328d-ac32-4a13-8a24-f6910cce4b6d service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:22.948003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0328d-ac32-4a13-8a24-f6910cce4b6d service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:22.948302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0328d-ac32-4a13-8a24-f6910cce4b6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:22.949907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dcf0328d-ac32-4a13-8a24-f6910cce4b6d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:23.037158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0328d-ac32-4a13-8a24-f6910cce4b6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:23.039283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0328d-ac32-4a13-8a24-f6910cce4b6d service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:23.057758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 700/1416] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:23.941592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4719-1bda-4dea-830f-b3e281373ef8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:23.942157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4719-1bda-4dea-830f-b3e281373ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:23.942157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a4719-1bda-4dea-830f-b3e281373ef8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:23.943396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:23.948560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc6b2c-911b-4038-b296-f465c9052c37 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:23.949015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc6b2c-911b-4038-b296-f465c9052c37 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:23.949122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc6b2c-911b-4038-b296-f465c9052c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:24.025144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6edc6b2c-911b-4038-b296-f465c9052c37 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:24.026350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6edc6b2c-911b-4038-b296-f465c9052c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:24.053423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:24.123345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:24.272396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a4719-1bda-4dea-830f-b3e281373ef8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:24.274472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ea3a4719-1bda-4dea-830f-b3e281373ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:24.536952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a4719-1bda-4dea-830f-b3e281373ef8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:24.576980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:24.650648 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb71d9-1052-42fe-be8d-5cacea7319ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:24.651252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb71d9-1052-42fe-be8d-5cacea7319ae service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:24.651532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb71d9-1052-42fe-be8d-5cacea7319ae service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:24.651803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb71d9-1052-42fe-be8d-5cacea7319ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:24.653418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-25bb71d9-1052-42fe-be8d-5cacea7319ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:24.741026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb71d9-1052-42fe-be8d-5cacea7319ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:24.742788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb71d9-1052-42fe-be8d-5cacea7319ae service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:24.760895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 718/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:25.647100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bdd38-5262-45e6-b1e4-be5781460059 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:25.647564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bdd38-5262-45e6-b1e4-be5781460059 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:25.647673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bdd38-5262-45e6-b1e4-be5781460059 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:25.649681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:39:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:25.654489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec167-c014-4732-b357-b9427a65041e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:25.654908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec167-c014-4732-b357-b9427a65041e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:25.655062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaec167-c014-4732-b357-b9427a65041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:25.709307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:25.733307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2eaec167-c014-4732-b357-b9427a65041e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:25.734539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2eaec167-c014-4732-b357-b9427a65041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:25.830794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:25.986214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bdd38-5262-45e6-b1e4-be5781460059 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:25.987688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-056bdd38-5262-45e6-b1e4-be5781460059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:26.133560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bdd38-5262-45e6-b1e4-be5781460059 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:26.145479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:26.246402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52241c5-2bd4-4686-9af1-ca8dd887cad5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:26.246916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52241c5-2bd4-4686-9af1-ca8dd887cad5 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:26.247194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52241c5-2bd4-4686-9af1-ca8dd887cad5 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:26.247463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52241c5-2bd4-4686-9af1-ca8dd887cad5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:26.249093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a52241c5-2bd4-4686-9af1-ca8dd887cad5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:26.337444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52241c5-2bd4-4686-9af1-ca8dd887cad5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:26.339026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52241c5-2bd4-4686-9af1-ca8dd887cad5 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:26.357411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 703/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:27.212832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0aedf-26bb-4a3d-a787-9bfe0723ae4a None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:27.213408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0aedf-26bb-4a3d-a787-9bfe0723ae4a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:27.213408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0aedf-26bb-4a3d-a787-9bfe0723ae4a None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:27.214725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:27.219698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c8c1-8aa3-47d3-9b48-0b437db5729c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:27.220136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c8c1-8aa3-47d3-9b48-0b437db5729c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:27.220286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8c8c1-8aa3-47d3-9b48-0b437db5729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:27.240637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:27.297965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-33a8c8c1-8aa3-47d3-9b48-0b437db5729c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:27.299160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-33a8c8c1-8aa3-47d3-9b48-0b437db5729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:27.395157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:39:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:27.546924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0aedf-26bb-4a3d-a787-9bfe0723ae4a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:27.548660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-eda0aedf-26bb-4a3d-a787-9bfe0723ae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:27.659136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:27.695611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0aedf-26bb-4a3d-a787-9bfe0723ae4a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:27.805821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ccb38-3f60-4ee4-a916-6122a522b579 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:27.806345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccb38-3f60-4ee4-a916-6122a522b579 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:27.806621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccb38-3f60-4ee4-a916-6122a522b579 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:27.806889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ccb38-3f60-4ee4-a916-6122a522b579 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:27.808510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1a5ccb38-3f60-4ee4-a916-6122a522b579 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:27.882091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:27.895435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ccb38-3f60-4ee4-a916-6122a522b579 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:27.897093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ccb38-3f60-4ee4-a916-6122a522b579 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:27.916471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 721/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:28.791795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddd4d-f4e9-4184-869f-c76f5cc09f81 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:28.792327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddd4d-f4e9-4184-869f-c76f5cc09f81 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:28.792453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ddd4d-f4e9-4184-869f-c76f5cc09f81 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:28.793753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:28.798809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff03816-0f0d-4693-80bf-02d1c117df10 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:28.799203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff03816-0f0d-4693-80bf-02d1c117df10 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:28.799357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff03816-0f0d-4693-80bf-02d1c117df10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:28.873611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4ff03816-0f0d-4693-80bf-02d1c117df10 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:28.874798 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4ff03816-0f0d-4693-80bf-02d1c117df10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:28.978699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:29.133224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddd4d-f4e9-4184-869f-c76f5cc09f81 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:29.134737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-825ddd4d-f4e9-4184-869f-c76f5cc09f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:29.219512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:29.286605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ddd4d-f4e9-4184-869f-c76f5cc09f81 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:29.400031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbb7b3-a09e-4eff-a01d-99e60c86441d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:29.400662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbb7b3-a09e-4eff-a01d-99e60c86441d service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:29.400939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbb7b3-a09e-4eff-a01d-99e60c86441d service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:29.401204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbb7b3-a09e-4eff-a01d-99e60c86441d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:29.402780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-07dbb7b3-a09e-4eff-a01d-99e60c86441d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:29.450285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:29.490887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbb7b3-a09e-4eff-a01d-99e60c86441d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:29.493194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbb7b3-a09e-4eff-a01d-99e60c86441d service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:29.511302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 706/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:30.321772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33194ab-4497-4121-b9d6-dfa3e0b2d1ae None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:30.322345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33194ab-4497-4121-b9d6-dfa3e0b2d1ae None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:30.322345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33194ab-4497-4121-b9d6-dfa3e0b2d1ae None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:30.323696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:30.328685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e8c0-7698-495e-b617-e664f628ac7a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:30.329121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e8c0-7698-495e-b617-e664f628ac7a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:30.329237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5e8c0-7698-495e-b617-e664f628ac7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:30.404827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-36d5e8c0-7698-495e-b617-e664f628ac7a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:30.406040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-36d5e8c0-7698-495e-b617-e664f628ac7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:30.504733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:39:30.656475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33194ab-4497-4121-b9d6-dfa3e0b2d1ae None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:30.657998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b33194ab-4497-4121-b9d6-dfa3e0b2d1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:30.706429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:30.801460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33194ab-4497-4121-b9d6-dfa3e0b2d1ae None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:30.913137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3e5ce-b5ea-46c6-9cbd-a9817dd50e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:30.913697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e5ce-b5ea-46c6-9cbd-a9817dd50e31 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:30.914113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e5ce-b5ea-46c6-9cbd-a9817dd50e31 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:30.914387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3e5ce-b5ea-46c6-9cbd-a9817dd50e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:30.915976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a0e3e5ce-b5ea-46c6-9cbd-a9817dd50e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:30.923105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:31.005902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e5ce-b5ea-46c6-9cbd-a9817dd50e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:31.008225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3e5ce-b5ea-46c6-9cbd-a9817dd50e31 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:31.026091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 724/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:31.829570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd2300-b647-4a35-96c3-f53bb3f62e72 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:31.830097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd2300-b647-4a35-96c3-f53bb3f62e72 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:31.830097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd2300-b647-4a35-96c3-f53bb3f62e72 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:31.831460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:31.837096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742451a3-4f65-4f41-8c67-23fc9fc9274a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:31.837523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742451a3-4f65-4f41-8c67-23fc9fc9274a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:31.837640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742451a3-4f65-4f41-8c67-23fc9fc9274a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:31.920986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-742451a3-4f65-4f41-8c67-23fc9fc9274a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:31.922849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-742451a3-4f65-4f41-8c67-23fc9fc9274a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:31.991611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:32.021624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:32.173654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd2300-b647-4a35-96c3-f53bb3f62e72 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:32.175086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-63fd2300-b647-4a35-96c3-f53bb3f62e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:32.193115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:32.323795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd2300-b647-4a35-96c3-f53bb3f62e72 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:32.409293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:32.435588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546ec3-e818-4b68-a04f-ce8671eefac4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:32.436122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546ec3-e818-4b68-a04f-ce8671eefac4 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:32.436440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546ec3-e818-4b68-a04f-ce8671eefac4 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:32.436712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546ec3-e818-4b68-a04f-ce8671eefac4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:32.438289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e8546ec3-e818-4b68-a04f-ce8671eefac4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:32.526231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8546ec3-e818-4b68-a04f-ce8671eefac4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:32.527827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8546ec3-e818-4b68-a04f-ce8671eefac4 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:32.546884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 709/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:33.358182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f429-f126-40ee-bb08-47ac2d83ef08 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:33.358740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f429-f126-40ee-bb08-47ac2d83ef08 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:33.358740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c169f429-f126-40ee-bb08-47ac2d83ef08 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:33.360123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:33.364951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655c87-85f7-4652-852c-f757f3db22f2 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:33.365407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655c87-85f7-4652-852c-f757f3db22f2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:33.365524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f655c87-85f7-4652-852c-f757f3db22f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:33.442135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9f655c87-85f7-4652-852c-f757f3db22f2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:33.443345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9f655c87-85f7-4652-852c-f757f3db22f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:33.485795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:33.542578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:33.696728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f429-f126-40ee-bb08-47ac2d83ef08 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:33.698276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c169f429-f126-40ee-bb08-47ac2d83ef08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:33.842485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c169f429-f126-40ee-bb08-47ac2d83ef08 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:33.896260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:33.955494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffab52e7-6089-469d-9305-7a3f2aa8c660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:33.956125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab52e7-6089-469d-9305-7a3f2aa8c660 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:33.956446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab52e7-6089-469d-9305-7a3f2aa8c660 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:33.956720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffab52e7-6089-469d-9305-7a3f2aa8c660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:33.958314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ffab52e7-6089-469d-9305-7a3f2aa8c660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:34.048271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab52e7-6089-469d-9305-7a3f2aa8c660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:34.049879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffab52e7-6089-469d-9305-7a3f2aa8c660 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:34.067462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 727/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:34.872330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecae729-2ffa-4677-a5bf-797556677434 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:34.872907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecae729-2ffa-4677-a5bf-797556677434 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:34.872907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecae729-2ffa-4677-a5bf-797556677434 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:34.874224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:34.879198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8172-4f65-4aad-a437-3db9452f276b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:34.879631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8172-4f65-4aad-a437-3db9452f276b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:34.879741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c8172-4f65-4aad-a437-3db9452f276b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:34.958946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-603c8172-4f65-4aad-a437-3db9452f276b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:34.960158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-603c8172-4f65-4aad-a437-3db9452f276b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:34.962289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:35.060232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:35.207861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecae729-2ffa-4677-a5bf-797556677434 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:35.209412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-eecae729-2ffa-4677-a5bf-797556677434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:35.368389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecae729-2ffa-4677-a5bf-797556677434 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:35.393825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:35.481024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3906ce6-8ca0-47e0-a46c-92398d520833 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:35.481623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3906ce6-8ca0-47e0-a46c-92398d520833 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:35.481898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3906ce6-8ca0-47e0-a46c-92398d520833 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:35.482166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3906ce6-8ca0-47e0-a46c-92398d520833 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:35.483750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e3906ce6-8ca0-47e0-a46c-92398d520833 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:35.574797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3906ce6-8ca0-47e0-a46c-92398d520833 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:35.576449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3906ce6-8ca0-47e0-a46c-92398d520833 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:35.606755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 712/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:37.433500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f346-a3d2-4175-ab6c-82227366f9d8 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:37.434074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f346-a3d2-4175-ab6c-82227366f9d8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:37.434074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98f346-a3d2-4175-ab6c-82227366f9d8 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:37.435511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:37.440874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c55de-8a0c-4fc6-b4a1-872a7f2e6fed None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:37.441302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c55de-8a0c-4fc6-b4a1-872a7f2e6fed None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:37.441418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c55de-8a0c-4fc6-b4a1-872a7f2e6fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:37.483828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:37.510149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b28c55de-8a0c-4fc6-b4a1-872a7f2e6fed None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:37.511365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b28c55de-8a0c-4fc6-b4a1-872a7f2e6fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:37.608690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:37.890501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f346-a3d2-4175-ab6c-82227366f9d8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:37.892061 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ff98f346-a3d2-4175-ab6c-82227366f9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:37.994890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98f346-a3d2-4175-ab6c-82227366f9d8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:38.030565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:38.071865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef0b84-38e7-44d3-b1a6-b63a13a2fa73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:38.072803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0b84-38e7-44d3-b1a6-b63a13a2fa73 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:38.073084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0b84-38e7-44d3-b1a6-b63a13a2fa73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:38.073354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef0b84-38e7-44d3-b1a6-b63a13a2fa73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:38.074973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d9ef0b84-38e7-44d3-b1a6-b63a13a2fa73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:38.182688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef0b84-38e7-44d3-b1a6-b63a13a2fa73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:38.184134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ef0b84-38e7-44d3-b1a6-b63a13a2fa73 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:38.202794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 730/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:40.236502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a6ff7-8f7e-4f3a-929a-fa32856f9adf None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:40.237100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a6ff7-8f7e-4f3a-929a-fa32856f9adf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:40.237100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a6ff7-8f7e-4f3a-929a-fa32856f9adf None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:40.238388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:40.244085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a41c-e244-4776-b53c-6dffef7a8b9b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:40.244566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a41c-e244-4776-b53c-6dffef7a8b9b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:40.244677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923a41c-e244-4776-b53c-6dffef7a8b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:40.310067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b923a41c-e244-4776-b53c-6dffef7a8b9b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:40.311264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b923a41c-e244-4776-b53c-6dffef7a8b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:40.323602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:40.406008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:40.687785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a6ff7-8f7e-4f3a-929a-fa32856f9adf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:40.689380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-131a6ff7-8f7e-4f3a-929a-fa32856f9adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:40.793294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a6ff7-8f7e-4f3a-929a-fa32856f9adf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:40.805389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:40.866210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852d993-c4d1-4718-83bc-49256307e959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:40.866855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d993-c4d1-4718-83bc-49256307e959 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:40.867131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d993-c4d1-4718-83bc-49256307e959 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:40.867400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d993-c4d1-4718-83bc-49256307e959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:40.869010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a852d993-c4d1-4718-83bc-49256307e959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:40.975820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852d993-c4d1-4718-83bc-49256307e959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:40.977815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852d993-c4d1-4718-83bc-49256307e959 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:40.995335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 715/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:43.231903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1aea9-e6d4-4868-91ba-cf5226f40d78 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:43.232466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1aea9-e6d4-4868-91ba-cf5226f40d78 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:43.232564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1aea9-e6d4-4868-91ba-cf5226f40d78 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:43.233837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:43.239026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa1eb-4d61-41f8-a227-04234bcd5191 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:43.239423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa1eb-4d61-41f8-a227-04234bcd5191 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:43.239583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941aa1eb-4d61-41f8-a227-04234bcd5191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:43.288222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:43.310702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-941aa1eb-4d61-41f8-a227-04234bcd5191 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:43.311943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-941aa1eb-4d61-41f8-a227-04234bcd5191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:43.407439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:43.700383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1aea9-e6d4-4868-91ba-cf5226f40d78 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:43.701957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-05b1aea9-e6d4-4868-91ba-cf5226f40d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:43.805602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1aea9-e6d4-4868-91ba-cf5226f40d78 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:43.844956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:43.878988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bf39c-ad4b-4257-ada6-51a5b9a005bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:43.879522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bf39c-ad4b-4257-ada6-51a5b9a005bc service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:43.879806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bf39c-ad4b-4257-ada6-51a5b9a005bc service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:43.880078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bf39c-ad4b-4257-ada6-51a5b9a005bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:43.881730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ad3bf39c-ad4b-4257-ada6-51a5b9a005bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:43.994146 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bf39c-ad4b-4257-ada6-51a5b9a005bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:43.995606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bf39c-ad4b-4257-ada6-51a5b9a005bc service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:44.016316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 733/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:46.035069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c43af0-b56e-4264-b416-11ad2ed5fd96 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:46.035575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c43af0-b56e-4264-b416-11ad2ed5fd96 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:46.035575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c43af0-b56e-4264-b416-11ad2ed5fd96 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:46.036912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:46.042530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08e56-726e-4589-a877-f1dcb3a602ab None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:46.042917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08e56-726e-4589-a877-f1dcb3a602ab None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:46.043084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f08e56-726e-4589-a877-f1dcb3a602ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:46.109287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-23f08e56-726e-4589-a877-f1dcb3a602ab None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:46.110487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-23f08e56-726e-4589-a877-f1dcb3a602ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:46.130678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:46.206257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:46.491778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c43af0-b56e-4264-b416-11ad2ed5fd96 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:46.493435 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e4c43af0-b56e-4264-b416-11ad2ed5fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:46.597724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c43af0-b56e-4264-b416-11ad2ed5fd96 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:46.617678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:46.671040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f774f-3495-4bc2-ac22-680c557e800b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:46.671649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f774f-3495-4bc2-ac22-680c557e800b service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:46.671929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f774f-3495-4bc2-ac22-680c557e800b service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:46.672224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f774f-3495-4bc2-ac22-680c557e800b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:46.674093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8b4f774f-3495-4bc2-ac22-680c557e800b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:46.783716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f774f-3495-4bc2-ac22-680c557e800b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:46.785099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f774f-3495-4bc2-ac22-680c557e800b service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:46.803893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 718/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:48.772792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a350e8-6bad-4112-bd73-c96e79a64349 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:48.773382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a350e8-6bad-4112-bd73-c96e79a64349 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:48.773382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a350e8-6bad-4112-bd73-c96e79a64349 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:48.774778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:48.780079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f13aff-732e-43e0-bec2-9187a951d539 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:48.780542 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f13aff-732e-43e0-bec2-9187a951d539 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:48.780652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f13aff-732e-43e0-bec2-9187a951d539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:48.844100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:48.847126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-07f13aff-732e-43e0-bec2-9187a951d539 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:48.848972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-07f13aff-732e-43e0-bec2-9187a951d539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:48.946155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:49.225468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a350e8-6bad-4112-bd73-c96e79a64349 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:49.227737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-08a350e8-6bad-4112-bd73-c96e79a64349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:49.331217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a350e8-6bad-4112-bd73-c96e79a64349 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:49.380636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:49.404775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7758d5-bf5d-4937-a8e1-63883ff5cc7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:49.405372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7758d5-bf5d-4937-a8e1-63883ff5cc7e service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:49.405649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7758d5-bf5d-4937-a8e1-63883ff5cc7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:49.405917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7758d5-bf5d-4937-a8e1-63883ff5cc7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:49.407538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8c7758d5-bf5d-4937-a8e1-63883ff5cc7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:49.516800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7758d5-bf5d-4937-a8e1-63883ff5cc7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:49.518180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7758d5-bf5d-4937-a8e1-63883ff5cc7e service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:49.536642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 736/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:51.530301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b6a9c-72a0-42cb-a027-940645a6dc83 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:51.530896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b6a9c-72a0-42cb-a027-940645a6dc83 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:51.530896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b6a9c-72a0-42cb-a027-940645a6dc83 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:51.532217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:51.537326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b989-3ba9-452d-807a-0e88ce261b7b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:51.537708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b989-3ba9-452d-807a-0e88ce261b7b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:51.537880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013b989-3ba9-452d-807a-0e88ce261b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:51.603660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0013b989-3ba9-452d-807a-0e88ce261b7b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:51.604904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0013b989-3ba9-452d-807a-0e88ce261b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:51.634451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:51.713541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:51.999629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b6a9c-72a0-42cb-a027-940645a6dc83 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:52.001275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4d3b6a9c-72a0-42cb-a027-940645a6dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:52.105293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b6a9c-72a0-42cb-a027-940645a6dc83 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:52.134118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:52.178715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675585f0-f279-4396-922b-89bc7cdb6144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:52.179322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675585f0-f279-4396-922b-89bc7cdb6144 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:52.179621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675585f0-f279-4396-922b-89bc7cdb6144 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:52.179874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675585f0-f279-4396-922b-89bc7cdb6144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:52.182028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-675585f0-f279-4396-922b-89bc7cdb6144 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:52.288800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675585f0-f279-4396-922b-89bc7cdb6144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:52.290760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675585f0-f279-4396-922b-89bc7cdb6144 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:52.309296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 721/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:54.284477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ae7a-f09f-4125-b9e0-10d72a06e2c9 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:54.285049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ae7a-f09f-4125-b9e0-10d72a06e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:54.285049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091ae7a-f09f-4125-b9e0-10d72a06e2c9 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:54.286365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:54.291551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a93c-c081-4209-acb1-76c632831534 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:54.291960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a93c-c081-4209-acb1-76c632831534 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:54.292142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183a93c-c081-4209-acb1-76c632831534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:54.359844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d183a93c-c081-4209-acb1-76c632831534 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:54.361105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d183a93c-c081-4209-acb1-76c632831534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:54.370145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:54.459783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:54.746781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ae7a-f09f-4125-b9e0-10d72a06e2c9 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:54.748395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5091ae7a-f09f-4125-b9e0-10d72a06e2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:54.852804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091ae7a-f09f-4125-b9e0-10d72a06e2c9 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:54.907144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:54.926205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131077f2-54ea-410c-b533-111e03005932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:54.926807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131077f2-54ea-410c-b533-111e03005932 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:54.927091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131077f2-54ea-410c-b533-111e03005932 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:54.927366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131077f2-54ea-410c-b533-111e03005932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:54.929014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-131077f2-54ea-410c-b533-111e03005932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:55.038063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131077f2-54ea-410c-b533-111e03005932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:55.039445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131077f2-54ea-410c-b533-111e03005932 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:55.058979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 739/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:56.997492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588987-968a-4b5b-8f9c-b9a1e719b0d9 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:56.998011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588987-968a-4b5b-8f9c-b9a1e719b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:56.998011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49588987-968a-4b5b-8f9c-b9a1e719b0d9 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:56.999294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:57.004838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d30b-188d-4f87-9293-ed1595656667 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:57.005268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d30b-188d-4f87-9293-ed1595656667 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:57.005557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d30b-188d-4f87-9293-ed1595656667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:57.070309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b331d30b-188d-4f87-9293-ed1595656667 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:57.072056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b331d30b-188d-4f87-9293-ed1595656667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:57.110801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:57.169094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:39:57.458014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588987-968a-4b5b-8f9c-b9a1e719b0d9 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:39:57.459564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-49588987-968a-4b5b-8f9c-b9a1e719b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:57.564617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49588987-968a-4b5b-8f9c-b9a1e719b0d9 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:39:57.601111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:57.637973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56122709-0a6d-4baf-8e98-ace2ea379678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:39:57.638578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122709-0a6d-4baf-8e98-ace2ea379678 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:57.638854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122709-0a6d-4baf-8e98-ace2ea379678 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:57.639122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56122709-0a6d-4baf-8e98-ace2ea379678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:57.640739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-56122709-0a6d-4baf-8e98-ace2ea379678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:57.751300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56122709-0a6d-4baf-8e98-ace2ea379678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:39:57.752765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56122709-0a6d-4baf-8e98-ace2ea379678 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:39:57.770779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 724/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:39:59.699498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a45dc-7f19-4ab2-8b55-5af7fe43f84f None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:59.700060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a45dc-7f19-4ab2-8b55-5af7fe43f84f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:59.700060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a45dc-7f19-4ab2-8b55-5af7fe43f84f None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:59.701438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:39:59.706979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5cc42-d2ea-4256-84e2-a6b5bcf1a999 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:39:59.707399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5cc42-d2ea-4256-84e2-a6b5bcf1a999 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:39:59.707517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5cc42-d2ea-4256-84e2-a6b5bcf1a999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:39:59.773460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a8c5cc42-d2ea-4256-84e2-a6b5bcf1a999 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:39:59.775515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a8c5cc42-d2ea-4256-84e2-a6b5bcf1a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:39:59.793856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:39:59.874138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:39:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:00.158396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a45dc-7f19-4ab2-8b55-5af7fe43f84f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:00.159921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d93a45dc-7f19-4ab2-8b55-5af7fe43f84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:00.262531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a45dc-7f19-4ab2-8b55-5af7fe43f84f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:00.331731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:00.338895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43bb34-93ff-4e50-8fef-6183bd45c69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:00.339632 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43bb34-93ff-4e50-8fef-6183bd45c69d service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:00.339922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43bb34-93ff-4e50-8fef-6183bd45c69d service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:00.340208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43bb34-93ff-4e50-8fef-6183bd45c69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:00.341808 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fe43bb34-93ff-4e50-8fef-6183bd45c69d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:00.452986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43bb34-93ff-4e50-8fef-6183bd45c69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:00.454349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43bb34-93ff-4e50-8fef-6183bd45c69d service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:00.473501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 742/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:02.398352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2062-03b9-4c40-9970-da0bc6f11832 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:02.398941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2062-03b9-4c40-9970-da0bc6f11832 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:02.398941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e2062-03b9-4c40-9970-da0bc6f11832 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:02.400551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:02.405730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ee5f2-7ea6-4366-9af0-170a202136d5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:02.406158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ee5f2-7ea6-4366-9af0-170a202136d5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:02.406281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ee5f2-7ea6-4366-9af0-170a202136d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:02.471262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-007ee5f2-7ea6-4366-9af0-170a202136d5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:02.472487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-007ee5f2-7ea6-4366-9af0-170a202136d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:02.522274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:02.573854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:02.856343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2062-03b9-4c40-9970-da0bc6f11832 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:02.857864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b81e2062-03b9-4c40-9970-da0bc6f11832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:02.959174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e2062-03b9-4c40-9970-da0bc6f11832 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:03.015629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:03.043809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04624bb8-da28-40c6-b6ed-e4b46da63b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:03.044443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04624bb8-da28-40c6-b6ed-e4b46da63b71 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:03.044722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04624bb8-da28-40c6-b6ed-e4b46da63b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:03.044991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04624bb8-da28-40c6-b6ed-e4b46da63b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:03.046570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-04624bb8-da28-40c6-b6ed-e4b46da63b71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:03.154264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04624bb8-da28-40c6-b6ed-e4b46da63b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:03.155701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04624bb8-da28-40c6-b6ed-e4b46da63b71 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:03.174060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 727/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:40:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:12.569453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=22 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:13.171533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=66 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:22.665786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583837b-ffea-4d2a-b44e-dc86d517344e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:22.666415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583837b-ffea-4d2a-b44e-dc86d517344e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:22.666415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1583837b-ffea-4d2a-b44e-dc86d517344e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:22.667752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 744/1471] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:22.673246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777bb0-fffe-40aa-b300-3afbcd5a1f1a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:22.673926 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777bb0-fffe-40aa-b300-3afbcd5a1f1a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:22.674083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a777bb0-fffe-40aa-b300-3afbcd5a1f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:22.740734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6a777bb0-fffe-40aa-b300-3afbcd5a1f1a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:22.741950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6a777bb0-fffe-40aa-b300-3afbcd5a1f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:22.838671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 728/1472] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:40:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:23.138111 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295ebf-a40e-4a3f-97dc-9306f9844452 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:23.138397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295ebf-a40e-4a3f-97dc-9306f9844452 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:23.138673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b295ebf-a40e-4a3f-97dc-9306f9844452 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:23.139998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 745/1473] 10.222.0.18 () {54 vars in 967 bytes} [Wed Aug 31 09:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:23.145026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5a0c-5753-467e-a6d5-a0a2f74b6983 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:23.145315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5a0c-5753-467e-a6d5-a0a2f74b6983 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:23.145587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a5a0c-5753-467e-a6d5-a0a2f74b6983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:23.221561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-953a5a0c-5753-467e-a6d5-a0a2f74b6983 None None] MFA Rules not processed for user `65c0bf4de3a1442c8b856efbfac436fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:23.222760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-953a5a0c-5753-467e-a6d5-a0a2f74b6983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:23.244528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:23.299911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 729/1474] 10.222.0.18 () {58 vars in 1064 bytes} [Wed Aug 31 09:40:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:23.308668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b295ebf-a40e-4a3f-97dc-9306f9844452 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:23.310190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3b295ebf-a40e-4a3f-97dc-9306f9844452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:23.411926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b295ebf-a40e-4a3f-97dc-9306f9844452 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:23.485087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329be9-96f0-46d2-af93-739cee2b4170 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c0bf4de3a1442c8b856efbfac436fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:23.485693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329be9-96f0-46d2-af93-739cee2b4170 service glance] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:23.485973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329be9-96f0-46d2-af93-739cee2b4170 service glance] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:23.486247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329be9-96f0-46d2-af93-739cee2b4170 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:23.487842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-36329be9-96f0-46d2-af93-739cee2b4170 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:23.542015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:23.596892 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36329be9-96f0-46d2-af93-739cee2b4170 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:23.598356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36329be9-96f0-46d2-af93-739cee2b4170 service glance] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:23.617149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 746/1475] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:40:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:25.607355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bdeaf-f0f5-4f4b-adad-942c041543c2 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:25.607967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bdeaf-f0f5-4f4b-adad-942c041543c2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:25.607967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bdeaf-f0f5-4f4b-adad-942c041543c2 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:25.609299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 730/1476] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:25.614595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82febdfd-53af-4b98-b5f2-e77d9531d177 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:25.614992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82febdfd-53af-4b98-b5f2-e77d9531d177 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:25.615143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82febdfd-53af-4b98-b5f2-e77d9531d177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:25.681286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-82febdfd-53af-4b98-b5f2-e77d9531d177 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:25.682498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-82febdfd-53af-4b98-b5f2-e77d9531d177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:25.780191 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 747/1477] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:26.058153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bdeaf-f0f5-4f4b-adad-942c041543c2 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:26.059607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8a7bdeaf-f0f5-4f4b-adad-942c041543c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:26.183748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bdeaf-f0f5-4f4b-adad-942c041543c2 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:26.232952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:26.277384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29878bcd-88ed-40ff-adbc-3a9d6f524472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:26.277981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878bcd-88ed-40ff-adbc-3a9d6f524472 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:26.278256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878bcd-88ed-40ff-adbc-3a9d6f524472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:26.278522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29878bcd-88ed-40ff-adbc-3a9d6f524472 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:26.279154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29878bcd-88ed-40ff-adbc-3a9d6f524472 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:26.281031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING py.warnings [None req-29878bcd-88ed-40ff-adbc-3a9d6f524472 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:40:26.281031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: warnings.warn(msg) Aug 31 09:40:26.281031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: Aug 31 09:40:26.282184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29878bcd-88ed-40ff-adbc-3a9d6f524472 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:26.300692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 731/1478] 10.222.0.18 () {56 vars in 1108 bytes} [Wed Aug 31 09:40:26 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:40:28.230443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c108b41-6405-409b-9ea0-5bc1caa62ae5 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:28.231013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c108b41-6405-409b-9ea0-5bc1caa62ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:28.231013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c108b41-6405-409b-9ea0-5bc1caa62ae5 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:28.232369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 748/1479] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:28.237951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29736b-7187-47d8-a2f3-937f98b7a0ac None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:28.238608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29736b-7187-47d8-a2f3-937f98b7a0ac None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:28.238857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29736b-7187-47d8-a2f3-937f98b7a0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:28.304340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3f29736b-7187-47d8-a2f3-937f98b7a0ac None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:28.305537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3f29736b-7187-47d8-a2f3-937f98b7a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:28.401574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 732/1480] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:40:28.698079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c108b41-6405-409b-9ea0-5bc1caa62ae5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:28.699616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0c108b41-6405-409b-9ea0-5bc1caa62ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:28.709435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:28.846879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c108b41-6405-409b-9ea0-5bc1caa62ae5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:28.926667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:28.960251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fbf67-23fe-4e1f-b989-e6d97e1a7e61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:28.960816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fbf67-23fe-4e1f-b989-e6d97e1a7e61 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:28.961099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fbf67-23fe-4e1f-b989-e6d97e1a7e61 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:28.961378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fbf67-23fe-4e1f-b989-e6d97e1a7e61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:28.963168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7f5fbf67-23fe-4e1f-b989-e6d97e1a7e61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:29.052877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fbf67-23fe-4e1f-b989-e6d97e1a7e61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:29.054482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fbf67-23fe-4e1f-b989-e6d97e1a7e61 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:29.072981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 749/1481] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:31.203175 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf83d30-dece-49ec-ac86-78d76727b08c None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:31.203770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf83d30-dece-49ec-ac86-78d76727b08c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:31.203770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf83d30-dece-49ec-ac86-78d76727b08c None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:31.205176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 733/1482] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:31.210462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bbef2-b9c8-4499-8b51-1ebc3cb2f636 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:31.210852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bbef2-b9c8-4499-8b51-1ebc3cb2f636 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:31.211003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bbef2-b9c8-4499-8b51-1ebc3cb2f636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:31.276679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5b6bbef2-b9c8-4499-8b51-1ebc3cb2f636 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:31.277887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5b6bbef2-b9c8-4499-8b51-1ebc3cb2f636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:31.323832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:31.372863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 750/1483] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:40:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:31.656840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf83d30-dece-49ec-ac86-78d76727b08c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:31.658371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bdf83d30-dece-49ec-ac86-78d76727b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:31.684207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:31.882584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf83d30-dece-49ec-ac86-78d76727b08c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:31.955685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78a333-3077-4c64-b9fc-e42824c68072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:31.956238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a333-3077-4c64-b9fc-e42824c68072 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:31.956517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a333-3077-4c64-b9fc-e42824c68072 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:31.956783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78a333-3077-4c64-b9fc-e42824c68072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:31.958380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3a78a333-3077-4c64-b9fc-e42824c68072 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:32.031220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:32.067688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78a333-3077-4c64-b9fc-e42824c68072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:32.069155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78a333-3077-4c64-b9fc-e42824c68072 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:32.086953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 734/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:34.063952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed759423-0f78-45c6-97c3-5f0fdb51afcc None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:34.064547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed759423-0f78-45c6-97c3-5f0fdb51afcc None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:34.064547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed759423-0f78-45c6-97c3-5f0fdb51afcc None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:34.065827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 751/1485] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:34.071061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a39e8-bde8-417a-9673-fca4e016abc2 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:34.071547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a39e8-bde8-417a-9673-fca4e016abc2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:34.072291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a39e8-bde8-417a-9673-fca4e016abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:34.139259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0d6a39e8-bde8-417a-9673-fca4e016abc2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:34.140496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0d6a39e8-bde8-417a-9673-fca4e016abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:34.234138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 735/1486] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:34.527224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed759423-0f78-45c6-97c3-5f0fdb51afcc None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:34.528823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ed759423-0f78-45c6-97c3-5f0fdb51afcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:34.633280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed759423-0f78-45c6-97c3-5f0fdb51afcc None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:34.705752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:34.707640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9c47d-9c58-4d57-b87a-67d6db093f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:34.708308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9c47d-9c58-4d57-b87a-67d6db093f4d service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:34.708790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9c47d-9c58-4d57-b87a-67d6db093f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:34.709231 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9c47d-9c58-4d57-b87a-67d6db093f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:34.711031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e4b9c47d-9c58-4d57-b87a-67d6db093f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:34.819547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9c47d-9c58-4d57-b87a-67d6db093f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:34.821012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b9c47d-9c58-4d57-b87a-67d6db093f4d service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:34.841610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 752/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:40:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:36.908738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7d8f-14f8-480c-91bf-7a40723df2bd None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:36.909299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7d8f-14f8-480c-91bf-7a40723df2bd None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:36.909299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7d8f-14f8-480c-91bf-7a40723df2bd None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:36.910618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 736/1488] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:36.916566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381906b-d14a-4050-8f38-f2bcf04eacca None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:36.917027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381906b-d14a-4050-8f38-f2bcf04eacca None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:36.917132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381906b-d14a-4050-8f38-f2bcf04eacca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:36.984254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c381906b-d14a-4050-8f38-f2bcf04eacca None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:36.985388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c381906b-d14a-4050-8f38-f2bcf04eacca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:37.037018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:37.081568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 753/1489] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:37.374995 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7d8f-14f8-480c-91bf-7a40723df2bd None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:37.376618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f6bf7d8f-14f8-480c-91bf-7a40723df2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:37.414346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:37.483008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7d8f-14f8-480c-91bf-7a40723df2bd None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:37.557038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bfd3f-da89-4481-b8a6-a3430cb16060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:37.557647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bfd3f-da89-4481-b8a6-a3430cb16060 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:37.557927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bfd3f-da89-4481-b8a6-a3430cb16060 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:37.558197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bfd3f-da89-4481-b8a6-a3430cb16060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:37.559808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-612bfd3f-da89-4481-b8a6-a3430cb16060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:37.639678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:37.668553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bfd3f-da89-4481-b8a6-a3430cb16060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:37.669996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bfd3f-da89-4481-b8a6-a3430cb16060 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:37.688737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 737/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:39.835283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceca848-1fc2-4162-beb7-f33d9a25f32d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:39.835816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceca848-1fc2-4162-beb7-f33d9a25f32d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:39.835816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceca848-1fc2-4162-beb7-f33d9a25f32d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:39.837719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 754/1491] 10.222.0.18 () {54 vars in 927 bytes} [Wed Aug 31 09:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:40:39.843144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfec2-4b99-490b-a47b-765843cb520c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:39.843566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfec2-4b99-490b-a47b-765843cb520c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:39.843706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55dfec2-4b99-490b-a47b-765843cb520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:39.910457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e55dfec2-4b99-490b-a47b-765843cb520c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:40:39.911677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e55dfec2-4b99-490b-a47b-765843cb520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:40.007790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 738/1492] 10.222.0.18 () {58 vars in 1024 bytes} [Wed Aug 31 09:40:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:40:40.301717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceca848-1fc2-4162-beb7-f33d9a25f32d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:40:40.303282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dceca848-1fc2-4162-beb7-f33d9a25f32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:40.405529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceca848-1fc2-4162-beb7-f33d9a25f32d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:40:40.477411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a38b9-43b0-4cf5-baf9-aa9c7b68231e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:40:40.478844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a38b9-43b0-4cf5-baf9-aa9c7b68231e service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:40:40.479121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a38b9-43b0-4cf5-baf9-aa9c7b68231e service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:40:40.479393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a38b9-43b0-4cf5-baf9-aa9c7b68231e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:40:40.481069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1f2a38b9-43b0-4cf5-baf9-aa9c7b68231e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:40:40.491896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:40.591791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a38b9-43b0-4cf5-baf9-aa9c7b68231e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:40:40.593181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a38b9-43b0-4cf5-baf9-aa9c7b68231e service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:40:40.611538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 755/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:40:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:40:50.005631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=82 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:40:50.609081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=50 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:54.273239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e3038-e1c6-4ce3-8105-b658c3dee178 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:54.273840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e3038-e1c6-4ce3-8105-b658c3dee178 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:54.273947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e3038-e1c6-4ce3-8105-b658c3dee178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:54.351411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6d3e3038-e1c6-4ce3-8105-b658c3dee178 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:41:54.352643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6d3e3038-e1c6-4ce3-8105-b658c3dee178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:54.450227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 739/1494] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:41:54.458058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074ec7-00f3-42a5-bcf3-f1524fbb1bff None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:54.458542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074ec7-00f3-42a5-bcf3-f1524fbb1bff None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:54.458658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d074ec7-00f3-42a5-bcf3-f1524fbb1bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:54.536153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7d074ec7-00f3-42a5-bcf3-f1524fbb1bff None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:41:54.537295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7d074ec7-00f3-42a5-bcf3-f1524fbb1bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:54.632300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 756/1495] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:41:54.637446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e3038-e1c6-4ce3-8105-b658c3dee178 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:54.638629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6d3e3038-e1c6-4ce3-8105-b658c3dee178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:54.649795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e3038-e1c6-4ce3-8105-b658c3dee178 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:54.711517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:54.745649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:54.746280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:54.746557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:54.746824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:54.747463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:41:54.747762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:54.748836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING py.warnings [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:41:54.748836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: warnings.warn(msg) Aug 31 09:41:54.748836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: Aug 31 09:41:54.749716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:54.761311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 740/1496] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:41:54.769457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074ec7-00f3-42a5-bcf3-f1524fbb1bff None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:54.778536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d074ec7-00f3-42a5-bcf3-f1524fbb1bff None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:54.839545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:54.872837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:54.873431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:54.873707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:54.873974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:54.874601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:54.876339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING py.warnings [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:41:54.876339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: warnings.warn(msg) Aug 31 09:41:54.876339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: Aug 31 09:41:54.877529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:54.934347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 757/1497] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:41:54 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:41:54.938568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:54.940222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:54.973097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4cdaa-332a-41ae-b68e-21f8335fae34 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:55.067010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:55.067592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:55.067868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:55.068136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:55.068798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:55.069792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING py.warnings [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:41:55.069792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: warnings.warn(msg) Aug 31 09:41:55.069792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: Aug 31 09:41:55.071007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:55.112771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 741/1498] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:41:54 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:41:55.117008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:55.118557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:55.180313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f84955-0bea-4035-afbb-61f91e1f5360 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:55.262813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:55.274233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:55.274883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:55.275165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:55.275443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:55.276105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:55.277975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING py.warnings [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:41:55.277975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: warnings.warn(msg) Aug 31 09:41:55.277975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: Aug 31 09:41:55.278875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:55.291141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 758/1499] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:41:55.295353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:55.296961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:55.308714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a1e2a-02ab-4b33-bea8-c35697a3cdfc admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:55.333486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:55.408753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afdeaa-dc82-4a29-b800-651e1e0f0d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:55.409274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afdeaa-dc82-4a29-b800-651e1e0f0d33 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:55.409549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afdeaa-dc82-4a29-b800-651e1e0f0d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:55.409818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afdeaa-dc82-4a29-b800-651e1e0f0d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:55.410459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afdeaa-dc82-4a29-b800-651e1e0f0d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:55.411466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING py.warnings [None req-f6afdeaa-dc82-4a29-b800-651e1e0f0d33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:41:55.411466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: warnings.warn(msg) Aug 31 09:41:55.411466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: Aug 31 09:41:55.412380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afdeaa-dc82-4a29-b800-651e1e0f0d33 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:55.424842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 742/1500] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:41:55.429272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:55.430879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:55.465067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b9ae46-5658-4879-af4a-54b1a632deda admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:55.559008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa2202-a253-446a-a40d-7ecf1bd578ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:55.559645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2202-a253-446a-a40d-7ecf1bd578ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:55.559924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2202-a253-446a-a40d-7ecf1bd578ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:55.560220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa2202-a253-446a-a40d-7ecf1bd578ac admin admin] PATH_INFO: `/v3/projects/e9c7ea53ded94959b70d5a693d4e10c1/users/924ecc8b6d734abca305810d07ddddec/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:55.582312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa2202-a253-446a-a40d-7ecf1bd578ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c7ea53ded94959b70d5a693d4e10c1, user_id=924ecc8b6d734abca305810d07ddddec, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:55.583352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING py.warnings [None req-31aa2202-a253-446a-a40d-7ecf1bd578ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:41:55.583352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: warnings.warn(msg) Aug 31 09:41:55.583352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: Aug 31 09:41:55.585333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa2202-a253-446a-a40d-7ecf1bd578ac admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:55.609865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 759/1501] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:41:55 2022] PUT /identity/v3/projects/e9c7ea53ded94959b70d5a693d4e10c1/users/924ecc8b6d734abca305810d07ddddec/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:41:55.622606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be32d6-a4d1-4d15-8f5c-0ef7682a0f48 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:55.622892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be32d6-a4d1-4d15-8f5c-0ef7682a0f48 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:55.623169 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be32d6-a4d1-4d15-8f5c-0ef7682a0f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:55.681396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-51be32d6-a4d1-4d15-8f5c-0ef7682a0f48 None None] MFA Rules not processed for user `924ecc8b6d734abca305810d07ddddec`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:41:55.682518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-51be32d6-a4d1-4d15-8f5c-0ef7682a0f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:55.759790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 743/1502] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:41:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:41:55.773439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd74c94-cf35-44a0-bab9-af9995eb7c4d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:55.773727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd74c94-cf35-44a0-bab9-af9995eb7c4d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:55.774031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd74c94-cf35-44a0-bab9-af9995eb7c4d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:55.775380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 760/1503] 10.222.0.18 () {54 vars in 964 bytes} [Wed Aug 31 09:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:41:55.780591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a59f-9288-435b-8675-082db77b58c5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:55.780878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a59f-9288-435b-8675-082db77b58c5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:55.781151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5a59f-9288-435b-8675-082db77b58c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:55.813490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:55.857593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-def5a59f-9288-435b-8675-082db77b58c5 None None] MFA Rules not processed for user `1aca2564475e4df98d4aef031d0b4302`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:41:55.858810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-def5a59f-9288-435b-8675-082db77b58c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:55.934746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 744/1504] 10.222.0.18 () {58 vars in 1061 bytes} [Wed Aug 31 09:41:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:41:55.944293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd74c94-cf35-44a0-bab9-af9995eb7c4d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:55.945813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9dd74c94-cf35-44a0-bab9-af9995eb7c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:55.995459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:56.054711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd74c94-cf35-44a0-bab9-af9995eb7c4d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:56.128514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:56.129114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:56.129397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:56.129679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:56.131277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:56.229588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:56.231576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:56.235087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:56.250711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 761/1505] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:41:55 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:41:56.295433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e6f5-5953-49ea-8edb-d04836ac2b39 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:56.295853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e6f5-5953-49ea-8edb-d04836ac2b39 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:56.295993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6e6f5-5953-49ea-8edb-d04836ac2b39 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:56.297345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 745/1506] 10.222.0.18 () {52 vars in 830 bytes} [Wed Aug 31 09:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:41:56.301016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:56.302496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:56.402335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeb5c7-3eab-4bdc-aae1-3b6ef11aa508 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:56.497329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:56.498004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:56.498142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:56.498415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] PATH_INFO: `/v3/users/924ecc8b6d734abca305810d07ddddec` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:56.510376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] RBAC: Authorizing `identity:delete_user(user_id=924ecc8b6d734abca305810d07ddddec)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:56.511515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING py.warnings [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:41:56.511515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: warnings.warn(msg) Aug 31 09:41:56.511515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: Aug 31 09:41:56.512799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:56.522780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:56.581780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924ecc8b6d734abca305810d07ddddec'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:56.582208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924ecc8b6d734abca305810d07ddddec'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:56.592142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924ecc8b6d734abca305810d07ddddec'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:56.614573 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924ecc8b6d734abca305810d07ddddec'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:56.628269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924ecc8b6d734abca305810d07ddddec'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:56.633938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 762/1507] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:41:56 2022] DELETE /identity/v3/users/924ecc8b6d734abca305810d07ddddec => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:41:56.638420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b4f49-0018-43a8-9cb5-e282ed239ef7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:56.638705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b4f49-0018-43a8-9cb5-e282ed239ef7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:56.638980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b4f49-0018-43a8-9cb5-e282ed239ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:56.695688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-fe4b4f49-0018-43a8-9cb5-e282ed239ef7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:41:56.696933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fe4b4f49-0018-43a8-9cb5-e282ed239ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:56.771710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:56.784402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 746/1508] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:41:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:41:56.794374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:56.795592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:56.893503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409645c2-e061-435b-9f24-07a03bf0637a admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:56.947698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:41:56.968145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819de3b0-48b5-4a63-845e-714180153b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:56.968778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de3b0-48b5-4a63-845e-714180153b2e service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:56.969063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de3b0-48b5-4a63-845e-714180153b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:56.969331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819de3b0-48b5-4a63-845e-714180153b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:56.970910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-819de3b0-48b5-4a63-845e-714180153b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:57.080575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819de3b0-48b5-4a63-845e-714180153b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:57.081945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819de3b0-48b5-4a63-845e-714180153b2e service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:57.102650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 763/1509] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:41:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:41:57.426667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b4f49-0018-43a8-9cb5-e282ed239ef7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:41:57.427889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fe4b4f49-0018-43a8-9cb5-e282ed239ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:41:57.439967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b4f49-0018-43a8-9cb5-e282ed239ef7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:41:57.538092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:41:57.538732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:41:57.539284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:41:57.539562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] PATH_INFO: `/v3/projects/e9c7ea53ded94959b70d5a693d4e10c1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:41:57.549972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c7ea53ded94959b70d5a693d4e10c1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:41:57.550993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING py.warnings [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:41:57.550993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: warnings.warn(msg) Aug 31 09:41:57.550993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: Aug 31 09:41:57.552489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:41:57.612831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c7ea53ded94959b70d5a693d4e10c1', 'request_id': 'req-43d753f8-1f98-4f71-8938-54975ddc6a92'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:57.622513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c7ea53ded94959b70d5a693d4e10c1', 'request_id': 'req-43d753f8-1f98-4f71-8938-54975ddc6a92'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:57.635867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c7ea53ded94959b70d5a693d4e10c1', 'request_id': 'req-43d753f8-1f98-4f71-8938-54975ddc6a92'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:57.657979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] The token cache is being invalidate because project e9c7ea53ded94959b70d5a693d4e10c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:41:57.658264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:57.658779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43d753f8-1f98-4f71-8938-54975ddc6a92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:41:57.660081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 747/1510] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:41:57 2022] DELETE /identity/v3/projects/e9c7ea53ded94959b70d5a693d4e10c1 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:42:07.100438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=62 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:42:07.655903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:43:34.205377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e44e4-733a-4abf-89bc-26e4f8a51159 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:34.205991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e44e4-733a-4abf-89bc-26e4f8a51159 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:34.205991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e44e4-733a-4abf-89bc-26e4f8a51159 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:34.207320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:43:34.212409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a19f-0aac-4317-a056-7609d1ff0f40 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:34.212845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a19f-0aac-4317-a056-7609d1ff0f40 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:34.213025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8a19f-0aac-4317-a056-7609d1ff0f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:34.293850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-56a8a19f-0aac-4317-a056-7609d1ff0f40 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:34.295056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-56a8a19f-0aac-4317-a056-7609d1ff0f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:34.396966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:34.561664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e44e4-733a-4abf-89bc-26e4f8a51159 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:43:34.563923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6a1e44e4-733a-4abf-89bc-26e4f8a51159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:34.680848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e44e4-733a-4abf-89bc-26e4f8a51159 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:43:34.686469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a66db-1471-4c42-8052-eed989ec9ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:43:34.687074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a66db-1471-4c42-8052-eed989ec9ba6 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:34.687359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a66db-1471-4c42-8052-eed989ec9ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:34.687636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a66db-1471-4c42-8052-eed989ec9ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:34.695601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a66db-1471-4c42-8052-eed989ec9ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:43:34.697242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a66db-1471-4c42-8052-eed989ec9ba6 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:43:34.707185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 765/1513] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:43:35.555202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8ee32-63de-4c7a-b37b-68ea5166f636 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:35.555768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8ee32-63de-4c7a-b37b-68ea5166f636 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:35.555768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8ee32-63de-4c7a-b37b-68ea5166f636 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:35.557137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:43:35.562190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f451a6-6d19-4c2b-b000-b9e9eda31c8e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:35.562583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f451a6-6d19-4c2b-b000-b9e9eda31c8e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:35.562760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f451a6-6d19-4c2b-b000-b9e9eda31c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:35.585161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-82f451a6-6d19-4c2b-b000-b9e9eda31c8e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:35.586396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-82f451a6-6d19-4c2b-b000-b9e9eda31c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:35.595000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:35.661092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2eb19-7878-4d28-bfd2-a00cc5058207 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:35.661480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2eb19-7878-4d28-bfd2-a00cc5058207 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:35.661828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2eb19-7878-4d28-bfd2-a00cc5058207 None None] PATH_INFO: `/v3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:35.663407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 750/1516] 10.222.0.55 () {54 vars in 925 bytes} [Wed Aug 31 09:43:35 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:43:35.673137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1917ca-5600-45d7-b868-fccd3a89fd6e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:35.673420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1917ca-5600-45d7-b868-fccd3a89fd6e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:35.673714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1917ca-5600-45d7-b868-fccd3a89fd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:35.734012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6e1917ca-5600-45d7-b868-fccd3a89fd6e None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:35.735211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6e1917ca-5600-45d7-b868-fccd3a89fd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:35.750231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2eb19-7878-4d28-bfd2-a00cc5058207 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:43:35.765732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2eb19-7878-4d28-bfd2-a00cc5058207 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:43:35.773012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecf7c1-ad38-45f9-ba06-b16dcf981124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:43:35.773616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf7c1-ad38-45f9-ba06-b16dcf981124 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:35.773891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf7c1-ad38-45f9-ba06-b16dcf981124 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:35.774214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecf7c1-ad38-45f9-ba06-b16dcf981124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:35.785145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf7c1-ad38-45f9-ba06-b16dcf981124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:43:35.786737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecf7c1-ad38-45f9-ba06-b16dcf981124 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:43:35.794657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:43:35.797618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 751/1517] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:43:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:43:35.814664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 767/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Aug 31 09:43:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:44.922049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6a5c8-394a-49b7-b255-4e3a56b01127 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:44.922596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6a5c8-394a-49b7-b255-4e3a56b01127 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:44.922596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa6a5c8-394a-49b7-b255-4e3a56b01127 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:44.923818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 752/1519] 10.222.0.18 () {54 vars in 961 bytes} [Wed Aug 31 09:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:43:44.929034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed920-bf49-4e35-a889-e6bcee451b0a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:44.929442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed920-bf49-4e35-a889-e6bcee451b0a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:44.929621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eed920-bf49-4e35-a889-e6bcee451b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:44.949694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-81eed920-bf49-4e35-a889-e6bcee451b0a None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:44.950912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-81eed920-bf49-4e35-a889-e6bcee451b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:44.959967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 768/1520] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Aug 31 09:43:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:44.967266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6a5c8-394a-49b7-b255-4e3a56b01127 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:43:44.980577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa6a5c8-394a-49b7-b255-4e3a56b01127 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:43:44.985429 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a49d2d-9571-4d0e-8ae0-ced79b1ea8a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:43:44.986011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49d2d-9571-4d0e-8ae0-ced79b1ea8a9 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:44.986290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49d2d-9571-4d0e-8ae0-ced79b1ea8a9 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:44.986559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a49d2d-9571-4d0e-8ae0-ced79b1ea8a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:44.997308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a49d2d-9571-4d0e-8ae0-ced79b1ea8a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:43:44.998869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a49d2d-9571-4d0e-8ae0-ced79b1ea8a9 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:43:45.009064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 753/1521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:43:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:43:47.028786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949a22-48f2-452a-ac59-2c3c5804c268 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:47.029316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949a22-48f2-452a-ac59-2c3c5804c268 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:47.029316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949a22-48f2-452a-ac59-2c3c5804c268 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:47.030640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 769/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:43:47.035433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e899b6-06b0-4956-8a52-41149d25191d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:47.035894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e899b6-06b0-4956-8a52-41149d25191d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:47.036001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e899b6-06b0-4956-8a52-41149d25191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:47.055540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-20e899b6-06b0-4956-8a52-41149d25191d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:47.056770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-20e899b6-06b0-4956-8a52-41149d25191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:47.064561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 754/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:43:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:47.225585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949a22-48f2-452a-ac59-2c3c5804c268 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:43:47.241026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949a22-48f2-452a-ac59-2c3c5804c268 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:43:47.246414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcb55d-bfff-4c0d-9036-3c1c140d0a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:43:47.247030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb55d-bfff-4c0d-9036-3c1c140d0a3c service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:47.247309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb55d-bfff-4c0d-9036-3c1c140d0a3c service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:47.247581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcb55d-bfff-4c0d-9036-3c1c140d0a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:47.255627 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb55d-bfff-4c0d-9036-3c1c140d0a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:43:47.257247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcb55d-bfff-4c0d-9036-3c1c140d0a3c service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:43:47.266439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 770/1524] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:43:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:43:48.091268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e75e-a6e0-4ced-a899-3464d763bba0 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:48.091808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e75e-a6e0-4ced-a899-3464d763bba0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:48.091808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e75e-a6e0-4ced-a899-3464d763bba0 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:48.093111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 755/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 09:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:43:48.097996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fac76-4fb9-4533-a05d-6b5076d55c0d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:48.098405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fac76-4fb9-4533-a05d-6b5076d55c0d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:48.098549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2fac76-4fb9-4533-a05d-6b5076d55c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:48.118364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5d2fac76-4fb9-4533-a05d-6b5076d55c0d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:48.119552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5d2fac76-4fb9-4533-a05d-6b5076d55c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:48.127561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 771/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 09:43:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:48.279897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e75e-a6e0-4ced-a899-3464d763bba0 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:43:48.294615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e75e-a6e0-4ced-a899-3464d763bba0 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:43:48.300059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99de0b-e15a-4f37-af4f-766ba5195739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:43:48.300700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99de0b-e15a-4f37-af4f-766ba5195739 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:48.300986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99de0b-e15a-4f37-af4f-766ba5195739 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:48.301255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99de0b-e15a-4f37-af4f-766ba5195739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:48.309433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99de0b-e15a-4f37-af4f-766ba5195739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:43:48.310997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99de0b-e15a-4f37-af4f-766ba5195739 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:43:48.320248 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 756/1527] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:43:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:43:52.435947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014fd27-a0a2-4455-9418-7dcbb5917e7e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:52.436541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014fd27-a0a2-4455-9418-7dcbb5917e7e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:52.436541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014fd27-a0a2-4455-9418-7dcbb5917e7e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:52.437907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 772/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:43:52.444314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8412d6-1608-496c-8960-6be1f12d1f57 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:52.444735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8412d6-1608-496c-8960-6be1f12d1f57 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:52.444865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8412d6-1608-496c-8960-6be1f12d1f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:52.464678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5d8412d6-1608-496c-8960-6be1f12d1f57 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:52.465874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5d8412d6-1608-496c-8960-6be1f12d1f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:52.474413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 757/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:52.762039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014fd27-a0a2-4455-9418-7dcbb5917e7e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:43:52.763730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d014fd27-a0a2-4455-9418-7dcbb5917e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:52.841885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014fd27-a0a2-4455-9418-7dcbb5917e7e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:43:52.845467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f71ae-2362-4ba7-a9cd-364fdfc0b605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:43:52.846069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f71ae-2362-4ba7-a9cd-364fdfc0b605 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:52.846351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f71ae-2362-4ba7-a9cd-364fdfc0b605 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:52.846627 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f71ae-2362-4ba7-a9cd-364fdfc0b605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:52.856132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f71ae-2362-4ba7-a9cd-364fdfc0b605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:43:52.857605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f71ae-2362-4ba7-a9cd-364fdfc0b605 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:43:52.866987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 773/1530] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:43:54.786012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712386e3-39de-4fb4-bcea-f4f2068dbfa8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:54.786602 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712386e3-39de-4fb4-bcea-f4f2068dbfa8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:54.786602 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712386e3-39de-4fb4-bcea-f4f2068dbfa8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:54.787912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 758/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:43:54.793153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba5be0-a516-42bd-8dc0-31e34b8ca8d4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:54.793594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba5be0-a516-42bd-8dc0-31e34b8ca8d4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:54.793694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba5be0-a516-42bd-8dc0-31e34b8ca8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:54.813759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e5ba5be0-a516-42bd-8dc0-31e34b8ca8d4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:54.814957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e5ba5be0-a516-42bd-8dc0-31e34b8ca8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:54.823455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 774/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:55.106865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712386e3-39de-4fb4-bcea-f4f2068dbfa8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:43:55.117779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712386e3-39de-4fb4-bcea-f4f2068dbfa8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:43:55.121321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5712c8b-ce9d-4a98-86cc-36067e02a09a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:43:55.121906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5712c8b-ce9d-4a98-86cc-36067e02a09a service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:55.122187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5712c8b-ce9d-4a98-86cc-36067e02a09a service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:55.122458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5712c8b-ce9d-4a98-86cc-36067e02a09a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:55.131852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5712c8b-ce9d-4a98-86cc-36067e02a09a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:43:55.133305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5712c8b-ce9d-4a98-86cc-36067e02a09a service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:43:55.142517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 759/1533] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:43:58.947951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d96ea-8283-48ab-9067-badc868d44e0 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:58.948535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d96ea-8283-48ab-9067-badc868d44e0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:58.948535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d96ea-8283-48ab-9067-badc868d44e0 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:58.949861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 775/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:43:58.956087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e81e-d746-499f-821e-67e131c99028 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:58.956542 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e81e-d746-499f-821e-67e131c99028 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:58.956647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246e81e-d746-499f-821e-67e131c99028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:58.964707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:43:58.979668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2246e81e-d746-499f-821e-67e131c99028 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:43:58.980830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2246e81e-d746-499f-821e-67e131c99028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:58.988551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 760/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:43:59.532847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d96ea-8283-48ab-9067-badc868d44e0 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:43:59.534539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-be1d96ea-8283-48ab-9067-badc868d44e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:43:59.613009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d96ea-8283-48ab-9067-badc868d44e0 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:43:59.617299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec8667-7157-4371-86ec-c1c62e5fab93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:43:59.617897 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8667-7157-4371-86ec-c1c62e5fab93 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:43:59.618177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8667-7157-4371-86ec-c1c62e5fab93 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:43:59.618452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec8667-7157-4371-86ec-c1c62e5fab93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:43:59.627271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec8667-7157-4371-86ec-c1c62e5fab93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:43:59.628750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec8667-7157-4371-86ec-c1c62e5fab93 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:43:59.638961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 776/1536] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:44:01.580443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0b5c-4825-4215-b63a-c0ec2187b6e6 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:44:01.581012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0b5c-4825-4215-b63a-c0ec2187b6e6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:44:01.581012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6db0b5c-4825-4215-b63a-c0ec2187b6e6 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:44:01.582335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 761/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 09:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:44:01.587579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa961b-b76c-456e-bc51-7becbd98e50f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:44:01.588104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa961b-b76c-456e-bc51-7becbd98e50f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:44:01.588104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa961b-b76c-456e-bc51-7becbd98e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:44:01.607792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5cfa961b-b76c-456e-bc51-7becbd98e50f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:44:01.609204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5cfa961b-b76c-456e-bc51-7becbd98e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:44:01.617664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 777/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 09:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:44:02.173766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0b5c-4825-4215-b63a-c0ec2187b6e6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:44:02.175452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b6db0b5c-4825-4215-b63a-c0ec2187b6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:44:02.189314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6db0b5c-4825-4215-b63a-c0ec2187b6e6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:44:02.193612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260da06c-cf2d-41fc-904c-6a66f8af51e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:44:02.194203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260da06c-cf2d-41fc-904c-6a66f8af51e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:44:02.194482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260da06c-cf2d-41fc-904c-6a66f8af51e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:44:02.194752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260da06c-cf2d-41fc-904c-6a66f8af51e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:44:02.203687 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260da06c-cf2d-41fc-904c-6a66f8af51e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:44:02.205151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260da06c-cf2d-41fc-904c-6a66f8af51e7 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:44:02.214506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 762/1539] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:44:11.602556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:44:12.210391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=8 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:42.062592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba41e-6eaf-408c-8de1-859cacdc505d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.063215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba41e-6eaf-408c-8de1-859cacdc505d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.063215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ba41e-6eaf-408c-8de1-859cacdc505d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.085616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3c0ba41e-6eaf-408c-8de1-859cacdc505d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.086848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3c0ba41e-6eaf-408c-8de1-859cacdc505d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.099611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 778/1540] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:42.108359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a63a4b-d3b6-45d4-ad97-44e90d72331d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.109318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a63a4b-d3b6-45d4-ad97-44e90d72331d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.109820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a63a4b-d3b6-45d4-ad97-44e90d72331d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.137040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-38a63a4b-d3b6-45d4-ad97-44e90d72331d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.138587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-38a63a4b-d3b6-45d4-ad97-44e90d72331d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.150774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 763/1541] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:45:42.156492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ba41e-6eaf-408c-8de1-859cacdc505d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.171242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ba41e-6eaf-408c-8de1-859cacdc505d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.179176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.179802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.180086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.180381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.181044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:42.181349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.182387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING py.warnings [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:45:42.182387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: warnings.warn(msg) Aug 31 09:45:42.182387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: Aug 31 09:45:42.183418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.201666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 779/1542] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:42.210640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a63a4b-d3b6-45d4-ad97-44e90d72331d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.221833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a63a4b-d3b6-45d4-ad97-44e90d72331d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.231764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceadcce-a1b5-42e7-bdec-5641141289da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.232690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceadcce-a1b5-42e7-bdec-5641141289da admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.233731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceadcce-a1b5-42e7-bdec-5641141289da admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.234229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceadcce-a1b5-42e7-bdec-5641141289da admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.235090 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceadcce-a1b5-42e7-bdec-5641141289da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.236362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING py.warnings [None req-fceadcce-a1b5-42e7-bdec-5641141289da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:45:42.236362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: warnings.warn(msg) Aug 31 09:45:42.236362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: Aug 31 09:45:42.238105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceadcce-a1b5-42e7-bdec-5641141289da admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.298943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 764/1543] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:42.303828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.314715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92657-db3e-48a9-933c-7d98381b81e5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.315407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92657-db3e-48a9-933c-7d98381b81e5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.315908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a92657-db3e-48a9-933c-7d98381b81e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.322545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3dd41-5301-4b8f-865a-c28eaa560bf6 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.353393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-89a92657-db3e-48a9-933c-7d98381b81e5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.355179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-89a92657-db3e-48a9-933c-7d98381b81e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.474516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41e531-9dbd-41d8-85ff-62b41f274790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.475758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e531-9dbd-41d8-85ff-62b41f274790 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.476342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e531-9dbd-41d8-85ff-62b41f274790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.476966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41e531-9dbd-41d8-85ff-62b41f274790 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.477838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41e531-9dbd-41d8-85ff-62b41f274790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.479116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING py.warnings [None req-cb41e531-9dbd-41d8-85ff-62b41f274790 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:45:42.479116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: warnings.warn(msg) Aug 31 09:45:42.479116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: Aug 31 09:45:42.486631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41e531-9dbd-41d8-85ff-62b41f274790 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.523285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 765/1544] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:45:42.524674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3678f5-a448-48fd-833c-9ab07dd4265f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.524965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3678f5-a448-48fd-833c-9ab07dd4265f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.525425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3678f5-a448-48fd-833c-9ab07dd4265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.543063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 780/1545] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/users => generated 303 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:42.544650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d220-efbc-4168-b9f7-056ab0b1d1f6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.545580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d220-efbc-4168-b9f7-056ab0b1d1f6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.545580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d220-efbc-4168-b9f7-056ab0b1d1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.573824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-fe3678f5-a448-48fd-833c-9ab07dd4265f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.574997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fe3678f5-a448-48fd-833c-9ab07dd4265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.596664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 766/1546] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:42.597372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3678f5-a448-48fd-833c-9ab07dd4265f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.602503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c741d220-efbc-4168-b9f7-056ab0b1d1f6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.603970 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c741d220-efbc-4168-b9f7-056ab0b1d1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.616759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3678f5-a448-48fd-833c-9ab07dd4265f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.633011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99531634-06fe-47c6-a86d-bc76f56c9ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.633968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531634-06fe-47c6-a86d-bc76f56c9ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.634262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531634-06fe-47c6-a86d-bc76f56c9ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.634538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99531634-06fe-47c6-a86d-bc76f56c9ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.636247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99531634-06fe-47c6-a86d-bc76f56c9ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.637281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99531634-06fe-47c6-a86d-bc76f56c9ea4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.638337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 781/1547] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:42.640269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a62f-a3aa-4b64-ab93-96eeeee47c04 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.640424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a62f-a3aa-4b64-ab93-96eeeee47c04 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.640628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63a62f-a3aa-4b64-ab93-96eeeee47c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.667837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 767/1548] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:42.669224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22517-89a3-4c2a-a3f8-1f51351b83ae None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.672196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22517-89a3-4c2a-a3f8-1f51351b83ae None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.672463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd22517-89a3-4c2a-a3f8-1f51351b83ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.700555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2fd22517-89a3-4c2a-a3f8-1f51351b83ae None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.702798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2fd22517-89a3-4c2a-a3f8-1f51351b83ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.708247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bc63a62f-a3aa-4b64-ab93-96eeeee47c04 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.708247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bc63a62f-a3aa-4b64-ab93-96eeeee47c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.722404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 768/1549] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:42.723289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22517-89a3-4c2a-a3f8-1f51351b83ae None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.728923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 782/1550] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:42.731844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63a62f-a3aa-4b64-ab93-96eeeee47c04 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.745770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd22517-89a3-4c2a-a3f8-1f51351b83ae None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.746038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63a62f-a3aa-4b64-ab93-96eeeee47c04 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.751882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623e6f4-a502-48ac-b6e7-6fb42638ec54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.752543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e6f4-a502-48ac-b6e7-6fb42638ec54 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.752928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e6f4-a502-48ac-b6e7-6fb42638ec54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.753306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e6f4-a502-48ac-b6e7-6fb42638ec54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.754142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623e6f4-a502-48ac-b6e7-6fb42638ec54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.756008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623e6f4-a502-48ac-b6e7-6fb42638ec54 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.758313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.758936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.759221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.759488 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.760145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:42.760473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.762082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.768451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 783/1551] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:42.769987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885a105-148e-4c90-a68a-7abf0167181d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.770279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885a105-148e-4c90-a68a-7abf0167181d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.770556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885a105-148e-4c90-a68a-7abf0167181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.778408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 769/1552] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:42.779588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.793751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a33bd7-d40a-4654-90d2-13d1e8271a8a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.800201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7885a105-148e-4c90-a68a-7abf0167181d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.800201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7885a105-148e-4c90-a68a-7abf0167181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.805933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c420d8-8ae9-402b-8169-bd44024ea7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.806842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c420d8-8ae9-402b-8169-bd44024ea7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.807336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c420d8-8ae9-402b-8169-bd44024ea7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.807819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c420d8-8ae9-402b-8169-bd44024ea7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.808727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c420d8-8ae9-402b-8169-bd44024ea7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:42.809263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c420d8-8ae9-402b-8169-bd44024ea7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.809455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 784/1553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:42.812450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c420d8-8ae9-402b-8169-bd44024ea7d5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.818001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654500-e430-47f5-9583-c8283090cbfd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.818293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654500-e430-47f5-9583-c8283090cbfd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.818573 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61654500-e430-47f5-9583-c8283090cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.827255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 770/1554] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:42.828918 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b78737-7512-4d6b-9e2d-80d9e1700466 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.829428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b78737-7512-4d6b-9e2d-80d9e1700466 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.829922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b78737-7512-4d6b-9e2d-80d9e1700466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.846610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-61654500-e430-47f5-9583-c8283090cbfd None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.848019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-61654500-e430-47f5-9583-c8283090cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.857428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 785/1555] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:42.859393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654500-e430-47f5-9583-c8283090cbfd None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.863451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-48b78737-7512-4d6b-9e2d-80d9e1700466 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.865007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-48b78737-7512-4d6b-9e2d-80d9e1700466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.876573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 771/1556] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:42.876991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61654500-e430-47f5-9583-c8283090cbfd None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.877398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b78737-7512-4d6b-9e2d-80d9e1700466 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.882585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f2729-9e2e-4fea-b2b4-82eb24f5823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.883260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f2729-9e2e-4fea-b2b4-82eb24f5823a admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.884220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f2729-9e2e-4fea-b2b4-82eb24f5823a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.884507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f2729-9e2e-4fea-b2b4-82eb24f5823a admin admin] PATH_INFO: `/v3/projects/a24d29ac9ce244558ed7f464ea4f4168/users/609b09cc9c7646d8baa986148b6e832f/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.889807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b78737-7512-4d6b-9e2d-80d9e1700466 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:42.896088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febd9a4-83a1-4002-8b00-a865f4cafba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:42.896742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febd9a4-83a1-4002-8b00-a865f4cafba0 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.897028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febd9a4-83a1-4002-8b00-a865f4cafba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.897302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febd9a4-83a1-4002-8b00-a865f4cafba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.897956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febd9a4-83a1-4002-8b00-a865f4cafba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.899866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febd9a4-83a1-4002-8b00-a865f4cafba0 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.902757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f2729-9e2e-4fea-b2b4-82eb24f5823a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a24d29ac9ce244558ed7f464ea4f4168, user_id=609b09cc9c7646d8baa986148b6e832f, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:42.905674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f2729-9e2e-4fea-b2b4-82eb24f5823a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:42.923170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 786/1557] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:42 2022] PUT /identity/v3/projects/a24d29ac9ce244558ed7f464ea4f4168/users/609b09cc9c7646d8baa986148b6e832f/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:42.924893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3205e-d1ed-4cfb-bbeb-d9ba59f7777f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:42.925182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3205e-d1ed-4cfb-bbeb-d9ba59f7777f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:42.925457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3205e-d1ed-4cfb-bbeb-d9ba59f7777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:42.932760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 772/1558] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:42.933893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febd9a4-83a1-4002-8b00-a865f4cafba0 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:42.955284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c9c3205e-d1ed-4cfb-bbeb-d9ba59f7777f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:42.956533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c9c3205e-d1ed-4cfb-bbeb-d9ba59f7777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:42.988272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:43.005776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febd9a4-83a1-4002-8b00-a865f4cafba0 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.010556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407d8e5-ac77-4eda-a7d8-944e93bcabe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.011170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407d8e5-ac77-4eda-a7d8-944e93bcabe3 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.011452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407d8e5-ac77-4eda-a7d8-944e93bcabe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.011725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407d8e5-ac77-4eda-a7d8-944e93bcabe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.012389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407d8e5-ac77-4eda-a7d8-944e93bcabe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.014888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407d8e5-ac77-4eda-a7d8-944e93bcabe3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.020435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 787/1559] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:43.021471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3205e-d1ed-4cfb-bbeb-d9ba59f7777f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.032712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3205e-d1ed-4cfb-bbeb-d9ba59f7777f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.038361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3033dd3-aa8d-4983-a0c9-4b76ae200240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.038999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033dd3-aa8d-4983-a0c9-4b76ae200240 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.039276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033dd3-aa8d-4983-a0c9-4b76ae200240 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.039542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3033dd3-aa8d-4983-a0c9-4b76ae200240 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.040211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033dd3-aa8d-4983-a0c9-4b76ae200240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:43.040517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033dd3-aa8d-4983-a0c9-4b76ae200240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.042129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3033dd3-aa8d-4983-a0c9-4b76ae200240 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.044726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:43.045838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 773/1560] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:42 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.047277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae16a-c13f-483b-a580-abeac03caf1f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.047576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae16a-c13f-483b-a580-abeac03caf1f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.047839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aae16a-c13f-483b-a580-abeac03caf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.057117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 788/1561] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:43.058613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429633-07c2-45e6-bff9-226552459956 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.059081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429633-07c2-45e6-bff9-226552459956 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.059592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff429633-07c2-45e6-bff9-226552459956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.070328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-80aae16a-c13f-483b-a580-abeac03caf1f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:43.071529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-80aae16a-c13f-483b-a580-abeac03caf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:43.080301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ff429633-07c2-45e6-bff9-226552459956 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:43.081353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ff429633-07c2-45e6-bff9-226552459956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:43.134551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 774/1562] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:43.137469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae10f-9f99-48d0-a7d2-c8683e57ffdd None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.137827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae10f-9f99-48d0-a7d2-c8683e57ffdd None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.138168 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceae10f-9f99-48d0-a7d2-c8683e57ffdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.142358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 789/1563] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:43.143322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff429633-07c2-45e6-bff9-226552459956 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.154048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff429633-07c2-45e6-bff9-226552459956 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.158875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d9be0-3104-4cf1-94d9-ea384fd655e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.159464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d9be0-3104-4cf1-94d9-ea384fd655e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.159746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d9be0-3104-4cf1-94d9-ea384fd655e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.160012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d9be0-3104-4cf1-94d9-ea384fd655e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.160669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d9be0-3104-4cf1-94d9-ea384fd655e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.162600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d9be0-3104-4cf1-94d9-ea384fd655e8 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.166571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-dceae10f-9f99-48d0-a7d2-c8683e57ffdd None None] MFA Rules not processed for user `609b09cc9c7646d8baa986148b6e832f`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:43.167901 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dceae10f-9f99-48d0-a7d2-c8683e57ffdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:43.190787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 790/1564] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.192638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a46d-2991-42d8-a395-a7c82085f510 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.192934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a46d-2991-42d8-a395-a7c82085f510 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.193227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a46d-2991-42d8-a395-a7c82085f510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.213288 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-df46a46d-2991-42d8-a395-a7c82085f510 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:43.214660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-df46a46d-2991-42d8-a395-a7c82085f510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:43.223641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 791/1565] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:43.224924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a46d-2991-42d8-a395-a7c82085f510 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.235853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a46d-2991-42d8-a395-a7c82085f510 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.242398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 775/1566] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:43.243298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae10f-9f99-48d0-a7d2-c8683e57ffdd None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.255053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceae10f-9f99-48d0-a7d2-c8683e57ffdd None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.259840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af99d7-ec73-4d4a-b8c5-6527dbd4f256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.260249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.260497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af99d7-ec73-4d4a-b8c5-6527dbd4f256 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.260776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af99d7-ec73-4d4a-b8c5-6527dbd4f256 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.260899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.261048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af99d7-ec73-4d4a-b8c5-6527dbd4f256 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.261210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.261437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.261691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af99d7-ec73-4d4a-b8c5-6527dbd4f256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.262147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:43.262495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.263646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af99d7-ec73-4d4a-b8c5-6527dbd4f256 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.264979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.278782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 792/1567] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:43.279619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.289132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 776/1568] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/users => generated 291 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.290537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d995f-6d06-4c00-ad9f-75cd50633e82 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.290886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d995f-6d06-4c00-ad9f-75cd50633e82 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.291130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250d05d-e2e4-4287-b195-82bdee1dce60 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.291273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d995f-6d06-4c00-ad9f-75cd50633e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.296482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee8e1-8aa3-4a9b-9512-ba1fef44abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.297088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee8e1-8aa3-4a9b-9512-ba1fef44abbf admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.297379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee8e1-8aa3-4a9b-9512-ba1fef44abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.297692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbee8e1-8aa3-4a9b-9512-ba1fef44abbf admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.298663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbee8e1-8aa3-4a9b-9512-ba1fef44abbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.300635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbee8e1-8aa3-4a9b-9512-ba1fef44abbf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.312386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-754d995f-6d06-4c00-ad9f-75cd50633e82 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:43.313700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-754d995f-6d06-4c00-ad9f-75cd50633e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:43.323722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 777/1569] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:43.324596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d995f-6d06-4c00-ad9f-75cd50633e82 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.337456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 793/1570] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.337456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee8e1-8aa3-4a9b-9512-ba1fef44abbf admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.337756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d995f-6d06-4c00-ad9f-75cd50633e82 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.374314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:43.401429 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdb798-f85a-4c3b-9c9a-3bdc430f3b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.402102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb798-f85a-4c3b-9c9a-3bdc430f3b31 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.402390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb798-f85a-4c3b-9c9a-3bdc430f3b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.402666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdb798-f85a-4c3b-9c9a-3bdc430f3b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.403322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdb798-f85a-4c3b-9c9a-3bdc430f3b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:43.403656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdb798-f85a-4c3b-9c9a-3bdc430f3b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.405586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdb798-f85a-4c3b-9c9a-3bdc430f3b31 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.409127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbee8e1-8aa3-4a9b-9512-ba1fef44abbf admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.413745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b628a45-210b-4373-ae53-724479027f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.414354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b628a45-210b-4373-ae53-724479027f2b admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.414634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b628a45-210b-4373-ae53-724479027f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.414908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b628a45-210b-4373-ae53-724479027f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.415579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b628a45-210b-4373-ae53-724479027f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.417216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b628a45-210b-4373-ae53-724479027f2b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.417557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 778/1571] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:43.418776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a562-fcc8-439d-b0e9-31da2af99648 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.419065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a562-fcc8-439d-b0e9-31da2af99648 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.419346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48a562-fcc8-439d-b0e9-31da2af99648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.429054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 794/1572] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:43.430301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b628a45-210b-4373-ae53-724479027f2b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.440120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-fa48a562-fcc8-439d-b0e9-31da2af99648 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:43.441367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fa48a562-fcc8-439d-b0e9-31da2af99648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:43.442882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b628a45-210b-4373-ae53-724479027f2b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.447640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c873e92-ec13-44a2-80c4-7b2445c11f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.448273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c873e92-ec13-44a2-80c4-7b2445c11f40 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.448554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c873e92-ec13-44a2-80c4-7b2445c11f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.448827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c873e92-ec13-44a2-80c4-7b2445c11f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.449465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c873e92-ec13-44a2-80c4-7b2445c11f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.449691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 779/1573] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:43.450468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48a562-fcc8-439d-b0e9-31da2af99648 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.454649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c873e92-ec13-44a2-80c4-7b2445c11f40 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.461549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48a562-fcc8-439d-b0e9-31da2af99648 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.466363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde069ec-8be6-4dc1-8827-8dbe487e8421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.466965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde069ec-8be6-4dc1-8827-8dbe487e8421 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.467249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde069ec-8be6-4dc1-8827-8dbe487e8421 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.467249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde069ec-8be6-4dc1-8827-8dbe487e8421 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.468227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde069ec-8be6-4dc1-8827-8dbe487e8421 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.470278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde069ec-8be6-4dc1-8827-8dbe487e8421 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.490820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 795/1574] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/projects => generated 405 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.492045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c873e92-ec13-44a2-80c4-7b2445c11f40 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.509880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 780/1575] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.509880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde069ec-8be6-4dc1-8827-8dbe487e8421 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.510179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:43.563591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c873e92-ec13-44a2-80c4-7b2445c11f40 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.583024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde069ec-8be6-4dc1-8827-8dbe487e8421 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.590296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.591241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.591741 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.592300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.593369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:43.593902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.596585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.616235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 781/1576] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:43.617680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.628277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95340645-892b-4510-8508-dd03efab1bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.628933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95340645-892b-4510-8508-dd03efab1bfd admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.629248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95340645-892b-4510-8508-dd03efab1bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.629518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95340645-892b-4510-8508-dd03efab1bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.630115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95340645-892b-4510-8508-dd03efab1bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.631741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95340645-892b-4510-8508-dd03efab1bfd admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.634179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec204a4-fb52-4693-8302-8d3d227be5e1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.639003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89405deb-6bae-4cff-b24b-f6f8f2e9c04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.639670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405deb-6bae-4cff-b24b-f6f8f2e9c04a admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.639944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405deb-6bae-4cff-b24b-f6f8f2e9c04a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.640245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89405deb-6bae-4cff-b24b-f6f8f2e9c04a admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.640933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89405deb-6bae-4cff-b24b-f6f8f2e9c04a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.642556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 796/1577] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:43.643021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89405deb-6bae-4cff-b24b-f6f8f2e9c04a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.643369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95340645-892b-4510-8508-dd03efab1bfd admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.654197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95340645-892b-4510-8508-dd03efab1bfd admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.659576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868b188-a883-4036-ae0b-7f7c5fc4eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.660254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868b188-a883-4036-ae0b-7f7c5fc4eb51 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.660527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868b188-a883-4036-ae0b-7f7c5fc4eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.660825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868b188-a883-4036-ae0b-7f7c5fc4eb51 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.661586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868b188-a883-4036-ae0b-7f7c5fc4eb51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.663752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868b188-a883-4036-ae0b-7f7c5fc4eb51 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.669063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 782/1578] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.669063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89405deb-6bae-4cff-b24b-f6f8f2e9c04a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.682187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89405deb-6bae-4cff-b24b-f6f8f2e9c04a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.691380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acdbab-6f9a-49f6-9411-d6fcc8185be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.692011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acdbab-6f9a-49f6-9411-d6fcc8185be3 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.692326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acdbab-6f9a-49f6-9411-d6fcc8185be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.692637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acdbab-6f9a-49f6-9411-d6fcc8185be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.693334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acdbab-6f9a-49f6-9411-d6fcc8185be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.696195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acdbab-6f9a-49f6-9411-d6fcc8185be3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.699391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 797/1579] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.700268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868b188-a883-4036-ae0b-7f7c5fc4eb51 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.712962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 783/1580] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:43.712962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acdbab-6f9a-49f6-9411-d6fcc8185be3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.720846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acdbab-6f9a-49f6-9411-d6fcc8185be3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.767813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868b188-a883-4036-ae0b-7f7c5fc4eb51 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.772783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.773393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.773677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.773949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.774603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:43.774903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.776550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.783699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107bffd-b7e0-4f48-93a5-779b4f9e8c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.784441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107bffd-b7e0-4f48-93a5-779b4f9e8c86 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.784716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107bffd-b7e0-4f48-93a5-779b4f9e8c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.784988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107bffd-b7e0-4f48-93a5-779b4f9e8c86 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.785654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107bffd-b7e0-4f48-93a5-779b4f9e8c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.787563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107bffd-b7e0-4f48-93a5-779b4f9e8c86 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.789708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 798/1581] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:43.790275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.803349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551602a2-7c95-41d2-884e-e5bec2e548f3 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.804739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:43.808932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acd8d9-4ae0-41d6-bfe1-c9285f473b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.809589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acd8d9-4ae0-41d6-bfe1-c9285f473b8b admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.809804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acd8d9-4ae0-41d6-bfe1-c9285f473b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.810074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61acd8d9-4ae0-41d6-bfe1-c9285f473b8b admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.810702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acd8d9-4ae0-41d6-bfe1-c9285f473b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.813797 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61acd8d9-4ae0-41d6-bfe1-c9285f473b8b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.819137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 784/1582] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/users => generated 309 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.820033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107bffd-b7e0-4f48-93a5-779b4f9e8c86 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.831674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107bffd-b7e0-4f48-93a5-779b4f9e8c86 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.836400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 799/1583] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.839546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52786600-3545-4196-9edd-41589973fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.839663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acd8d9-4ae0-41d6-bfe1-c9285f473b8b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.839752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52786600-3545-4196-9edd-41589973fb03 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.839752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52786600-3545-4196-9edd-41589973fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.839752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52786600-3545-4196-9edd-41589973fb03 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.839752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52786600-3545-4196-9edd-41589973fb03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.840403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52786600-3545-4196-9edd-41589973fb03 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.847695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61acd8d9-4ae0-41d6-bfe1-c9285f473b8b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.852682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e24f5-72db-46b1-bf46-da583f02f4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.853278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e24f5-72db-46b1-bf46-da583f02f4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.853557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e24f5-72db-46b1-bf46-da583f02f4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.853827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e24f5-72db-46b1-bf46-da583f02f4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.854461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e24f5-72db-46b1-bf46-da583f02f4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.856068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e24f5-72db-46b1-bf46-da583f02f4e4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.858812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:43.870651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 800/1584] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:43.871367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e24f5-72db-46b1-bf46-da583f02f4e4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.872032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 785/1585] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.876164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52786600-3545-4196-9edd-41589973fb03 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.881702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e24f5-72db-46b1-bf46-da583f02f4e4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.940557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52786600-3545-4196-9edd-41589973fb03 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.941556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6c08e-ac6b-4f13-a9be-547f819dbe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.942127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6c08e-ac6b-4f13-a9be-547f819dbe9d admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.942411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6c08e-ac6b-4f13-a9be-547f819dbe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.942685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6c08e-ac6b-4f13-a9be-547f819dbe9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.943325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6c08e-ac6b-4f13-a9be-547f819dbe9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.944977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6c08e-ac6b-4f13-a9be-547f819dbe9d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.945416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3cc39-d27f-4d2d-976f-bd6d44276993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.946047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cc39-d27f-4d2d-976f-bd6d44276993 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.946324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cc39-d27f-4d2d-976f-bd6d44276993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.946589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3cc39-d27f-4d2d-976f-bd6d44276993 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.947247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3cc39-d27f-4d2d-976f-bd6d44276993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.949229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3cc39-d27f-4d2d-976f-bd6d44276993 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.955106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 801/1586] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:43.958436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6c08e-ac6b-4f13-a9be-547f819dbe9d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.968799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6c08e-ac6b-4f13-a9be-547f819dbe9d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.971646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 786/1587] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:43.972657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3cc39-d27f-4d2d-976f-bd6d44276993 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:43.976473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29053c3-034c-489c-9efb-62a822baf5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.977124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29053c3-034c-489c-9efb-62a822baf5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.977410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29053c3-034c-489c-9efb-62a822baf5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.977687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29053c3-034c-489c-9efb-62a822baf5eb admin admin] PATH_INFO: `/v3/projects/589e6abb53954f818a6d139fef7e4251/users/9f8b22bc870c4341b48d83e2e5821372/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.982329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3cc39-d27f-4d2d-976f-bd6d44276993 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:43.987079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8d28d-2f41-43e7-98f8-f5b6687306bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:43.987667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d28d-2f41-43e7-98f8-f5b6687306bc admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:43.987943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d28d-2f41-43e7-98f8-f5b6687306bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:43.988244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8d28d-2f41-43e7-98f8-f5b6687306bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:43.988869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8d28d-2f41-43e7-98f8-f5b6687306bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.990766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8d28d-2f41-43e7-98f8-f5b6687306bc admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:43.993031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29053c3-034c-489c-9efb-62a822baf5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=589e6abb53954f818a6d139fef7e4251, user_id=9f8b22bc870c4341b48d83e2e5821372, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:43.996097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29053c3-034c-489c-9efb-62a822baf5eb admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.010990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 802/1588] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:43 2022] PUT /identity/v3/projects/589e6abb53954f818a6d139fef7e4251/users/9f8b22bc870c4341b48d83e2e5821372/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:44.016207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29053c3-034c-489c-9efb-62a822baf5eb admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.019771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 787/1589] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:43 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:44.020679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8d28d-2f41-43e7-98f8-f5b6687306bc admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.081813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29053c3-034c-489c-9efb-62a822baf5eb admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.083144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8d28d-2f41-43e7-98f8-f5b6687306bc admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.086456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc2523-a06d-4353-9c30-b0a243b1e149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.087058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2523-a06d-4353-9c30-b0a243b1e149 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.087335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2523-a06d-4353-9c30-b0a243b1e149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.087609 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc2523-a06d-4353-9c30-b0a243b1e149 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.087855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c7fbc-bd0f-4c90-9d35-8099a4f5b5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.088275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc2523-a06d-4353-9c30-b0a243b1e149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.088495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7fbc-bd0f-4c90-9d35-8099a4f5b5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.088774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7fbc-bd0f-4c90-9d35-8099a4f5b5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.089048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7fbc-bd0f-4c90-9d35-8099a4f5b5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.089692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c7fbc-bd0f-4c90-9d35-8099a4f5b5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.089878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fc2523-a06d-4353-9c30-b0a243b1e149 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.091476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c7fbc-bd0f-4c90-9d35-8099a4f5b5c7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.100335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 803/1590] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.101274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc2523-a06d-4353-9c30-b0a243b1e149 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.102523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 788/1591] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.103301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c7fbc-bd0f-4c90-9d35-8099a4f5b5c7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.111933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc2523-a06d-4353-9c30-b0a243b1e149 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.113699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c7fbc-bd0f-4c90-9d35-8099a4f5b5c7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.116629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe0cf-c1c9-4479-8074-678327198924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.117292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe0cf-c1c9-4479-8074-678327198924 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.117557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe0cf-c1c9-4479-8074-678327198924 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.117880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fe0cf-c1c9-4479-8074-678327198924 admin admin] PATH_INFO: `/v3/projects/60dcf51abce1472b822ff986e334368d/users/8ee69641352444a29bc7db558b3875bc/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.118385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572289f-f9eb-4058-a174-77f370e41851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.118976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572289f-f9eb-4058-a174-77f370e41851 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.119254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572289f-f9eb-4058-a174-77f370e41851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.119521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572289f-f9eb-4058-a174-77f370e41851 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.120142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572289f-f9eb-4058-a174-77f370e41851 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.122084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572289f-f9eb-4058-a174-77f370e41851 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.132426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe0cf-c1c9-4479-8074-678327198924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60dcf51abce1472b822ff986e334368d, user_id=8ee69641352444a29bc7db558b3875bc, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.135348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fe0cf-c1c9-4479-8074-678327198924 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.148862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 789/1592] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:44 2022] POST /identity/v3/users => generated 290 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:44.148862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572289f-f9eb-4058-a174-77f370e41851 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.152578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 804/1593] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:44 2022] PUT /identity/v3/projects/60dcf51abce1472b822ff986e334368d/users/8ee69641352444a29bc7db558b3875bc/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:44.153221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe0cf-c1c9-4479-8074-678327198924 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.157118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572289f-f9eb-4058-a174-77f370e41851 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.175837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:44.205977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:44.223548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c0085-10c7-470d-9791-12403709e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.224242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0085-10c7-470d-9791-12403709e754 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.224619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0085-10c7-470d-9791-12403709e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.224993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c0085-10c7-470d-9791-12403709e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.226062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0085-10c7-470d-9791-12403709e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.226673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fe0cf-c1c9-4479-8074-678327198924 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.228514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c0085-10c7-470d-9791-12403709e754 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.232028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af720c1-2280-4b1c-b245-f162b14c01b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.232677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af720c1-2280-4b1c-b245-f162b14c01b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.233084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af720c1-2280-4b1c-b245-f162b14c01b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.233489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af720c1-2280-4b1c-b245-f162b14c01b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.234504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af720c1-2280-4b1c-b245-f162b14c01b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.236118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af720c1-2280-4b1c-b245-f162b14c01b8 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.244459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 790/1594] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.244459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d8c3f-79c5-4e40-9cbe-aaa719d65209 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.244459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d8c3f-79c5-4e40-9cbe-aaa719d65209 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.244459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d8c3f-79c5-4e40-9cbe-aaa719d65209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.253837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 805/1595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.253837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af720c1-2280-4b1c-b245-f162b14c01b8 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.263904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af720c1-2280-4b1c-b245-f162b14c01b8 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.266115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e06d8c3f-79c5-4e40-9cbe-aaa719d65209 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:44.267321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e06d8c3f-79c5-4e40-9cbe-aaa719d65209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:44.269732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cc1fe-b1c3-4547-b7b1-e22a33469322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.270338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cc1fe-b1c3-4547-b7b1-e22a33469322 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.270653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cc1fe-b1c3-4547-b7b1-e22a33469322 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.270982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cc1fe-b1c3-4547-b7b1-e22a33469322 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.271637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cc1fe-b1c3-4547-b7b1-e22a33469322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.273615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42cc1fe-b1c3-4547-b7b1-e22a33469322 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.275289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 791/1596] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:44.275906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d8c3f-79c5-4e40-9cbe-aaa719d65209 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.286400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d8c3f-79c5-4e40-9cbe-aaa719d65209 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.292397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309138d0-9d0b-433b-9a48-44714a05d45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.293015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309138d0-9d0b-433b-9a48-44714a05d45d admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.293292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309138d0-9d0b-433b-9a48-44714a05d45d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.293562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309138d0-9d0b-433b-9a48-44714a05d45d admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.294206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309138d0-9d0b-433b-9a48-44714a05d45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.295830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309138d0-9d0b-433b-9a48-44714a05d45d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.298076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 806/1597] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:44 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:44.299170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cc1fe-b1c3-4547-b7b1-e22a33469322 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.308927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42cc1fe-b1c3-4547-b7b1-e22a33469322 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.310222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 792/1598] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.311066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309138d0-9d0b-433b-9a48-44714a05d45d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.314363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872eb8f-0a75-4b8d-951c-4067009f96f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.315035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872eb8f-0a75-4b8d-951c-4067009f96f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.315344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872eb8f-0a75-4b8d-951c-4067009f96f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.315593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6872eb8f-0a75-4b8d-951c-4067009f96f3 admin admin] PATH_INFO: `/v3/projects/d33c42c2f1764e18960dcc3c564f68c9/users/b7498b9528a74158b4a2e784c2d6fde6/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.320959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309138d0-9d0b-433b-9a48-44714a05d45d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.325581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de03f560-cb05-44bc-ab27-e7a19133b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.326191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03f560-cb05-44bc-ab27-e7a19133b70f admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.326463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03f560-cb05-44bc-ab27-e7a19133b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.327270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03f560-cb05-44bc-ab27-e7a19133b70f admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.327941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03f560-cb05-44bc-ab27-e7a19133b70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.329579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de03f560-cb05-44bc-ab27-e7a19133b70f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.333271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872eb8f-0a75-4b8d-951c-4067009f96f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33c42c2f1764e18960dcc3c564f68c9, user_id=b7498b9528a74158b4a2e784c2d6fde6, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.335978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6872eb8f-0a75-4b8d-951c-4067009f96f3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.345985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 793/1599] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.345985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383db5-2f1c-4529-9ddf-7f7a46a75a28 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.345985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383db5-2f1c-4529-9ddf-7f7a46a75a28 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.345985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b383db5-2f1c-4529-9ddf-7f7a46a75a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.355851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 807/1600] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:44 2022] PUT /identity/v3/projects/d33c42c2f1764e18960dcc3c564f68c9/users/b7498b9528a74158b4a2e784c2d6fde6/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:44.356857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872eb8f-0a75-4b8d-951c-4067009f96f3 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.375889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2b383db5-2f1c-4529-9ddf-7f7a46a75a28 None None] MFA Rules not processed for user `8ee69641352444a29bc7db558b3875bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:44.377159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2b383db5-2f1c-4529-9ddf-7f7a46a75a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:44.423567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6872eb8f-0a75-4b8d-951c-4067009f96f3 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.428620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564beb2-ec3f-4bef-9a76-bc80423fb493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.429281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564beb2-ec3f-4bef-9a76-bc80423fb493 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.429569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564beb2-ec3f-4bef-9a76-bc80423fb493 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.429844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564beb2-ec3f-4bef-9a76-bc80423fb493 admin admin] PATH_INFO: `/v3/projects/f067200a44ca4db39c4e081e755711f3/users/2f4f149b17ac48c4931338cc7b0b2112/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.442575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 794/1601] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:44.443489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383db5-2f1c-4529-9ddf-7f7a46a75a28 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.446136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564beb2-ec3f-4bef-9a76-bc80423fb493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f067200a44ca4db39c4e081e755711f3, user_id=2f4f149b17ac48c4931338cc7b0b2112, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.449099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564beb2-ec3f-4bef-9a76-bc80423fb493 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.454390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b383db5-2f1c-4529-9ddf-7f7a46a75a28 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.460073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee532997-6037-47e2-a561-46009d7d9d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.460697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532997-6037-47e2-a561-46009d7d9d10 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.460971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532997-6037-47e2-a561-46009d7d9d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.461240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee532997-6037-47e2-a561-46009d7d9d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.461880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee532997-6037-47e2-a561-46009d7d9d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.463451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee532997-6037-47e2-a561-46009d7d9d10 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.464322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 808/1602] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:44 2022] PUT /identity/v3/projects/f067200a44ca4db39c4e081e755711f3/users/2f4f149b17ac48c4931338cc7b0b2112/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:44.465171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564beb2-ec3f-4bef-9a76-bc80423fb493 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.474566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 795/1603] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.475393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee532997-6037-47e2-a561-46009d7d9d10 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.484704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee532997-6037-47e2-a561-46009d7d9d10 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.524835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564beb2-ec3f-4bef-9a76-bc80423fb493 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.528544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d1aa5-67f3-4e89-acc7-39b0bf337da8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.529149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d1aa5-67f3-4e89-acc7-39b0bf337da8 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.529429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d1aa5-67f3-4e89-acc7-39b0bf337da8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.529822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d1aa5-67f3-4e89-acc7-39b0bf337da8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.542908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b735-2634-4eab-b409-f03c8dba770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.543531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b735-2634-4eab-b409-f03c8dba770d admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.543814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b735-2634-4eab-b409-f03c8dba770d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.544092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273b735-2634-4eab-b409-f03c8dba770d admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.544771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273b735-2634-4eab-b409-f03c8dba770d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.546496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273b735-2634-4eab-b409-f03c8dba770d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.557672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 796/1604] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.561707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b735-2634-4eab-b409-f03c8dba770d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.568530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:44.570853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:44.575997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273b735-2634-4eab-b409-f03c8dba770d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.582817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.583697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.584204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.584900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] PATH_INFO: `/v3/projects/bf68376e1bd840fc92e6631cd72bf505/users/d73bfaf743ed4039b7127fbee22bf5a9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.601709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf68376e1bd840fc92e6631cd72bf505, user_id=d73bfaf743ed4039b7127fbee22bf5a9, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.602791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING py.warnings [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:45:44.602791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: warnings.warn(msg) Aug 31 09:45:44.602791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: Aug 31 09:45:44.604819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.605113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d1aa5-67f3-4e89-acc7-39b0bf337da8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.606630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d1aa5-67f3-4e89-acc7-39b0bf337da8 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.618454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 809/1605] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:44.619387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d1aa5-67f3-4e89-acc7-39b0bf337da8 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.619939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 797/1606] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:44 2022] PUT /identity/v3/projects/bf68376e1bd840fc92e6631cd72bf505/users/d73bfaf743ed4039b7127fbee22bf5a9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:44.620541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.642504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d1aa5-67f3-4e89-acc7-39b0bf337da8 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.698738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7023947-5e8b-4de1-a0df-64e89abe3107 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.705513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a633c1-2641-4b74-a443-a3429d5d7e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.706613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a633c1-2641-4b74-a443-a3429d5d7e8c admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.706911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a633c1-2641-4b74-a443-a3429d5d7e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.707192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a633c1-2641-4b74-a443-a3429d5d7e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.707850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a633c1-2641-4b74-a443-a3429d5d7e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.709588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a633c1-2641-4b74-a443-a3429d5d7e8c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.718631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b519c-7c82-4409-a251-3ab97e25b108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.719656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b519c-7c82-4409-a251-3ab97e25b108 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.720185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b519c-7c82-4409-a251-3ab97e25b108 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.720635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b519c-7c82-4409-a251-3ab97e25b108 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.721613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b519c-7c82-4409-a251-3ab97e25b108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.722931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 798/1607] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.723627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a633c1-2641-4b74-a443-a3429d5d7e8c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.724430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b519c-7c82-4409-a251-3ab97e25b108 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.735538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a633c1-2641-4b74-a443-a3429d5d7e8c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.739406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 810/1608] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.740901 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd542e-77e0-4988-add1-0d34b048382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.741524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd542e-77e0-4988-add1-0d34b048382e admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.741731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca920e-60dd-4545-867f-48fd173189ff None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.741847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd542e-77e0-4988-add1-0d34b048382e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.742087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd542e-77e0-4988-add1-0d34b048382e admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.742523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca920e-60dd-4545-867f-48fd173189ff None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.742968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca920e-60dd-4545-867f-48fd173189ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.743102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd542e-77e0-4988-add1-0d34b048382e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.745045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd542e-77e0-4988-add1-0d34b048382e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.767728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4fca920e-60dd-4545-867f-48fd173189ff None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:44.769357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4fca920e-60dd-4545-867f-48fd173189ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:44.779188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 811/1609] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:44.780832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca920e-60dd-4545-867f-48fd173189ff None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.787567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 799/1610] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:44 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:44.789329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd542e-77e0-4988-add1-0d34b048382e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.801849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca920e-60dd-4545-867f-48fd173189ff None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.884627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd542e-77e0-4988-add1-0d34b048382e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:44.892645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398c872-89e6-4f74-aaa4-90db9bd46e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.893270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398c872-89e6-4f74-aaa4-90db9bd46e4b admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.893866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398c872-89e6-4f74-aaa4-90db9bd46e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.893983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398c872-89e6-4f74-aaa4-90db9bd46e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.894632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398c872-89e6-4f74-aaa4-90db9bd46e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.897124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dad978-8b3e-4a48-9884-b0282e8d25e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:44.897858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad978-8b3e-4a48-9884-b0282e8d25e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.898210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad978-8b3e-4a48-9884-b0282e8d25e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.898558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dad978-8b3e-4a48-9884-b0282e8d25e4 admin admin] PATH_INFO: `/v3/projects/48cc1f402f3b4d58ad2c3e8de14095f7/users/d5f210085ee04473b2808f0a2dfc37ac/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.900311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398c872-89e6-4f74-aaa4-90db9bd46e4b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.918558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 800/1611] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:44.918558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4308ef-b3d5-4481-ac47-e4daf5752f35 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:44.918558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4308ef-b3d5-4481-ac47-e4daf5752f35 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:44.918558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4308ef-b3d5-4481-ac47-e4daf5752f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:44.921428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dad978-8b3e-4a48-9884-b0282e8d25e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cc1f402f3b4d58ad2c3e8de14095f7, user_id=d5f210085ee04473b2808f0a2dfc37ac, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:44.924557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dad978-8b3e-4a48-9884-b0282e8d25e4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:44.944253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 812/1612] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:44 2022] PUT /identity/v3/projects/48cc1f402f3b4d58ad2c3e8de14095f7/users/d5f210085ee04473b2808f0a2dfc37ac/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:44.949158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dad978-8b3e-4a48-9884-b0282e8d25e4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:44.965537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-1d4308ef-b3d5-4481-ac47-e4daf5752f35 None None] MFA Rules not processed for user `d73bfaf743ed4039b7127fbee22bf5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:44.968112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1d4308ef-b3d5-4481-ac47-e4daf5752f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:45.014024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:45.042608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dad978-8b3e-4a48-9884-b0282e8d25e4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.048991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:45.049656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6503f8d-fc0c-4b08-b16e-b71897476581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.050982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503f8d-fc0c-4b08-b16e-b71897476581 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.051338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503f8d-fc0c-4b08-b16e-b71897476581 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.051698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6503f8d-fc0c-4b08-b16e-b71897476581 admin admin] PATH_INFO: `/v3/projects/d33c42c2f1764e18960dcc3c564f68c9/users/b7498b9528a74158b4a2e784c2d6fde6/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.056330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6503f8d-fc0c-4b08-b16e-b71897476581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d33c42c2f1764e18960dcc3c564f68c9, user_id=b7498b9528a74158b4a2e784c2d6fde6, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:45.059082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6503f8d-fc0c-4b08-b16e-b71897476581 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:45.082517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 813/1613] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:44 2022] PUT /identity/v3/projects/d33c42c2f1764e18960dcc3c564f68c9/users/b7498b9528a74158b4a2e784c2d6fde6/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:45.092501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6503f8d-fc0c-4b08-b16e-b71897476581 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:45.093418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 801/1614] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:45.094765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4308ef-b3d5-4481-ac47-e4daf5752f35 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:45.109271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4308ef-b3d5-4481-ac47-e4daf5752f35 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.166723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6503f8d-fc0c-4b08-b16e-b71897476581 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.172686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b32f4-8b8b-406c-8dc7-9ea981b8b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.173882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.174473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b32f4-8b8b-406c-8dc7-9ea981b8b815 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.174648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.175015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.175221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b32f4-8b8b-406c-8dc7-9ea981b8b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.175403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.175798 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b32f4-8b8b-406c-8dc7-9ea981b8b815 admin admin] PATH_INFO: `/v3/projects/c568c3f685264d9f95448c09486c3400/users/f683b4c8736f45649d9514d5635e9255/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.176187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:45.178192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:45.194522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b32f4-8b8b-406c-8dc7-9ea981b8b815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c568c3f685264d9f95448c09486c3400, user_id=f683b4c8736f45649d9514d5635e9255, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:45.197324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b32f4-8b8b-406c-8dc7-9ea981b8b815 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:45.205625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 802/1615] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:45 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:45.206623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:45.208766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:45.212469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 814/1616] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:45 2022] PUT /identity/v3/projects/c568c3f685264d9f95448c09486c3400/users/f683b4c8736f45649d9514d5635e9255/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:45.213573 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b32f4-8b8b-406c-8dc7-9ea981b8b815 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:45.274131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2495ab-7f99-449b-af5f-d455b27185b2 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.307301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b32f4-8b8b-406c-8dc7-9ea981b8b815 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.314428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91757685-75f0-4a02-aad5-ea9c61d96d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.315138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757685-75f0-4a02-aad5-ea9c61d96d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.315467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757685-75f0-4a02-aad5-ea9c61d96d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.315778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91757685-75f0-4a02-aad5-ea9c61d96d3f admin admin] PATH_INFO: `/v3/projects/e02ba702c6f34372b26fa0a55893242b/users/4e9b6afdd0644537a0b69799fc0e34fa/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.335305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91757685-75f0-4a02-aad5-ea9c61d96d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e02ba702c6f34372b26fa0a55893242b, user_id=4e9b6afdd0644537a0b69799fc0e34fa, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:45.338898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91757685-75f0-4a02-aad5-ea9c61d96d3f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:45.340680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ca9fe-9343-4196-b48d-9f54a4b4fe96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.341410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca9fe-9343-4196-b48d-9f54a4b4fe96 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.341765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca9fe-9343-4196-b48d-9f54a4b4fe96 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.343023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ca9fe-9343-4196-b48d-9f54a4b4fe96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.361193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ca9fe-9343-4196-b48d-9f54a4b4fe96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:45.362827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ca9fe-9343-4196-b48d-9f54a4b4fe96 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:45.365092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 815/1617] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:45 2022] PUT /identity/v3/projects/e02ba702c6f34372b26fa0a55893242b/users/4e9b6afdd0644537a0b69799fc0e34fa/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:45.366692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a4b3-dfd2-4df4-974e-2c09bd80013e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.367287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a4b3-dfd2-4df4-974e-2c09bd80013e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.368232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a4b3-dfd2-4df4-974e-2c09bd80013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.381675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 803/1618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:45.383552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d68303-b8b1-4086-82c7-8173110b5478 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.384534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d68303-b8b1-4086-82c7-8173110b5478 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.385210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d68303-b8b1-4086-82c7-8173110b5478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.397287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0272a4b3-dfd2-4df4-974e-2c09bd80013e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:45.398523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0272a4b3-dfd2-4df4-974e-2c09bd80013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:45.437460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e5d68303-b8b1-4086-82c7-8173110b5478 None None] MFA Rules not processed for user `b7498b9528a74158b4a2e784c2d6fde6`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:45.439271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e5d68303-b8b1-4086-82c7-8173110b5478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:45.463445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:45.489519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:45.536466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 816/1619] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:45.539351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272a4b3-dfd2-4df4-974e-2c09bd80013e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:45.563744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272a4b3-dfd2-4df4-974e-2c09bd80013e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.575629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee65af-53e0-474c-812e-2fd1d0ee2ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.578078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee65af-53e0-474c-812e-2fd1d0ee2ff7 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.578078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee65af-53e0-474c-812e-2fd1d0ee2ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.578303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee65af-53e0-474c-812e-2fd1d0ee2ff7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.580058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee65af-53e0-474c-812e-2fd1d0ee2ff7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:45.586131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee65af-53e0-474c-812e-2fd1d0ee2ff7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:45.593975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 804/1620] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:45.598949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d68303-b8b1-4086-82c7-8173110b5478 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:45.627992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d68303-b8b1-4086-82c7-8173110b5478 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.636764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd08993-1ada-4741-8350-986ece269301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.637877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd08993-1ada-4741-8350-986ece269301 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.638104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd08993-1ada-4741-8350-986ece269301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.645513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd08993-1ada-4741-8350-986ece269301 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.646797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd08993-1ada-4741-8350-986ece269301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:45.650630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd08993-1ada-4741-8350-986ece269301 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:45.656218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 817/1621] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:45 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:45.661045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99392a-6337-46ae-a2cc-0795a5397e90 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.661045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99392a-6337-46ae-a2cc-0795a5397e90 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.662478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed99392a-6337-46ae-a2cc-0795a5397e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.678364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 805/1622] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:45.679963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a9094-32ba-4b6d-a6ae-4f6d1b98e776 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.681192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a9094-32ba-4b6d-a6ae-4f6d1b98e776 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.681550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a9094-32ba-4b6d-a6ae-4f6d1b98e776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.707042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ed99392a-6337-46ae-a2cc-0795a5397e90 None None] MFA Rules not processed for user `f683b4c8736f45649d9514d5635e9255`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:45.709625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ed99392a-6337-46ae-a2cc-0795a5397e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:45.718613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-681a9094-32ba-4b6d-a6ae-4f6d1b98e776 None None] MFA Rules not processed for user `4e9b6afdd0644537a0b69799fc0e34fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:45.721080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-681a9094-32ba-4b6d-a6ae-4f6d1b98e776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:45.807419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 818/1623] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:45.810723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99392a-6337-46ae-a2cc-0795a5397e90 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:45.830612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 806/1624] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:45.831598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a9094-32ba-4b6d-a6ae-4f6d1b98e776 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:45.958015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed99392a-6337-46ae-a2cc-0795a5397e90 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.965031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce5bfc-33e9-45de-9263-7d6f7a5c2d61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.966262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5bfc-33e9-45de-9263-7d6f7a5c2d61 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.969412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5bfc-33e9-45de-9263-7d6f7a5c2d61 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.969817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce5bfc-33e9-45de-9263-7d6f7a5c2d61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:45.984036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a9094-32ba-4b6d-a6ae-4f6d1b98e776 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:45.993199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63b9a1-f601-47e9-8f35-1f43a4081547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:45.993943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63b9a1-f601-47e9-8f35-1f43a4081547 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:45.994754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63b9a1-f601-47e9-8f35-1f43a4081547 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:45.994754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63b9a1-f601-47e9-8f35-1f43a4081547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.103794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:46.115827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce5bfc-33e9-45de-9263-7d6f7a5c2d61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.119254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce5bfc-33e9-45de-9263-7d6f7a5c2d61 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.135618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63b9a1-f601-47e9-8f35-1f43a4081547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.137454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63b9a1-f601-47e9-8f35-1f43a4081547 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.138466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:46.152236 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 807/1625] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:45 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:46.153190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63b9a1-f601-47e9-8f35-1f43a4081547 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.155530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 819/1626] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:46.157792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce5bfc-33e9-45de-9263-7d6f7a5c2d61 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.169885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63b9a1-f601-47e9-8f35-1f43a4081547 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:46.176730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fddd42-473a-4364-ba8c-51bc0457a52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:46.178074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fddd42-473a-4364-ba8c-51bc0457a52b admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.178473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fddd42-473a-4364-ba8c-51bc0457a52b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.178928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fddd42-473a-4364-ba8c-51bc0457a52b admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.179871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fddd42-473a-4364-ba8c-51bc0457a52b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.182349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fddd42-473a-4364-ba8c-51bc0457a52b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.185213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce5bfc-33e9-45de-9263-7d6f7a5c2d61 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:46.208251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c758ad-fe0b-4cf0-915d-9b87db707a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:46.208948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c758ad-fe0b-4cf0-915d-9b87db707a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.209382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c758ad-fe0b-4cf0-915d-9b87db707a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.209521 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c758ad-fe0b-4cf0-915d-9b87db707a20 admin admin] PATH_INFO: `/v3/projects/ce4c28e5a4af4abaa0aa8b893f2509bf/users/f1fb19b957574f4b80736fce35ab26bb/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.212321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 808/1627] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:46 2022] POST /identity/v3/users => generated 292 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:46.217916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fddd42-473a-4364-ba8c-51bc0457a52b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.230098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fddd42-473a-4364-ba8c-51bc0457a52b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:46.238649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bf6fd-eb6a-45a9-b01c-3921942037b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:46.241894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf6fd-eb6a-45a9-b01c-3921942037b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.242340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf6fd-eb6a-45a9-b01c-3921942037b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.243398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf6fd-eb6a-45a9-b01c-3921942037b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.249120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bf6fd-eb6a-45a9-b01c-3921942037b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.251207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bf6fd-eb6a-45a9-b01c-3921942037b4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.253566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c758ad-fe0b-4cf0-915d-9b87db707a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4c28e5a4af4abaa0aa8b893f2509bf, user_id=f1fb19b957574f4b80736fce35ab26bb, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.257596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c758ad-fe0b-4cf0-915d-9b87db707a20 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.286714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 820/1628] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:46 2022] PUT /identity/v3/projects/ce4c28e5a4af4abaa0aa8b893f2509bf/users/f1fb19b957574f4b80736fce35ab26bb/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:46.289230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4755-9c93-45b7-909c-7b952889f49e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.289622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4755-9c93-45b7-909c-7b952889f49e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.290018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4755-9c93-45b7-909c-7b952889f49e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.292114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 821/1629] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 31 09:45:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:45:46.293276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4755-9c93-45b7-909c-7b952889f49e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.325694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 809/1630] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:46 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:46.327230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bf6fd-eb6a-45a9-b01c-3921942037b4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.411744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4755-9c93-45b7-909c-7b952889f49e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:46.474158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bf6fd-eb6a-45a9-b01c-3921942037b4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:46.485706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a49d6-1d8b-4496-87e5-1445265c12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:46.486337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a49d6-1d8b-4496-87e5-1445265c12a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.486616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a49d6-1d8b-4496-87e5-1445265c12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.486886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a49d6-1d8b-4496-87e5-1445265c12a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.487562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a49d6-1d8b-4496-87e5-1445265c12a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.489377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a49d6-1d8b-4496-87e5-1445265c12a8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.521727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 810/1631] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:46.523453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd415-b3de-4ad4-8619-bccb12350d8c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.524117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd415-b3de-4ad4-8619-bccb12350d8c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.524432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cd415-b3de-4ad4-8619-bccb12350d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.557078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a728be-be92-4366-adb4-5b4fb1fc443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:46.557078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a728be-be92-4366-adb4-5b4fb1fc443e admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.557490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a728be-be92-4366-adb4-5b4fb1fc443e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.560685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a728be-be92-4366-adb4-5b4fb1fc443e admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.565528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a728be-be92-4366-adb4-5b4fb1fc443e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.573293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a728be-be92-4366-adb4-5b4fb1fc443e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.594068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-166cd415-b3de-4ad4-8619-bccb12350d8c None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:46.595791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 822/1632] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:46.596093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-166cd415-b3de-4ad4-8619-bccb12350d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:46.601640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a728be-be92-4366-adb4-5b4fb1fc443e admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.618804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a728be-be92-4366-adb4-5b4fb1fc443e admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:46.626953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18b680-a01f-46e7-b293-1aa3abb9f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:46.627969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b680-a01f-46e7-b293-1aa3abb9f1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.628737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b680-a01f-46e7-b293-1aa3abb9f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.629240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed18b680-a01f-46e7-b293-1aa3abb9f1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.630118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18b680-a01f-46e7-b293-1aa3abb9f1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.632883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed18b680-a01f-46e7-b293-1aa3abb9f1c3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.683075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 823/1633] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:46 2022] POST /identity/v3/users => generated 296 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:46.684955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18b680-a01f-46e7-b293-1aa3abb9f1c3 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.707145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed18b680-a01f-46e7-b293-1aa3abb9f1c3 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:46.714005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1193e5-14d0-40e0-89fb-c3d48223394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:46.714917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1193e5-14d0-40e0-89fb-c3d48223394a admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.715344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1193e5-14d0-40e0-89fb-c3d48223394a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.715755 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1193e5-14d0-40e0-89fb-c3d48223394a admin admin] PATH_INFO: `/v3/projects/ce4c28e5a4af4abaa0aa8b893f2509bf/users/f1fb19b957574f4b80736fce35ab26bb/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.726290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1193e5-14d0-40e0-89fb-c3d48223394a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4c28e5a4af4abaa0aa8b893f2509bf, user_id=f1fb19b957574f4b80736fce35ab26bb, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.731738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1193e5-14d0-40e0-89fb-c3d48223394a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:46.743958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 811/1634] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 31 09:45:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:46.743958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd415-b3de-4ad4-8619-bccb12350d8c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.816914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cd415-b3de-4ad4-8619-bccb12350d8c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:46.832406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 824/1635] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:46 2022] PUT /identity/v3/projects/ce4c28e5a4af4abaa0aa8b893f2509bf/users/f1fb19b957574f4b80736fce35ab26bb/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:46.832406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1193e5-14d0-40e0-89fb-c3d48223394a admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:46.875387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:46.977140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:46.978584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:46.979072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:46.980183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:46.981199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] PATH_INFO: `/v3/users/609b09cc9c7646d8baa986148b6e832f` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:46.984779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] RBAC: Authorizing `identity:delete_user(user_id=609b09cc9c7646d8baa986148b6e832f)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:46.988543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: WARNING py.warnings [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:45:46.988543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: warnings.warn(msg) Aug 31 09:45:46.988543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: Aug 31 09:45:46.996015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:47.019681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1193e5-14d0-40e0-89fb-c3d48223394a admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:47.032930 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d9029-7da1-42be-a276-e69eb42cdff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:47.035548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d9029-7da1-42be-a276-e69eb42cdff0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:47.035951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d9029-7da1-42be-a276-e69eb42cdff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:47.040657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d9029-7da1-42be-a276-e69eb42cdff0 admin admin] PATH_INFO: `/v3/projects/1d1992e2ee6544c3969102e7c7c245bf/users/db42ebc7be5b4e9080d26cf3cb5603ef/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:47.078933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d9029-7da1-42be-a276-e69eb42cdff0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1992e2ee6544c3969102e7c7c245bf, user_id=db42ebc7be5b4e9080d26cf3cb5603ef, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:47.084693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d9029-7da1-42be-a276-e69eb42cdff0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:47.117802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 825/1636] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:46 2022] PUT /identity/v3/projects/1d1992e2ee6544c3969102e7c7c245bf/users/db42ebc7be5b4e9080d26cf3cb5603ef/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:47.119143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d9029-7da1-42be-a276-e69eb42cdff0 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:47.140712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609b09cc9c7646d8baa986148b6e832f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:47.183171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609b09cc9c7646d8baa986148b6e832f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:47.184749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609b09cc9c7646d8baa986148b6e832f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:47.185604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609b09cc9c7646d8baa986148b6e832f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:47.206665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d9029-7da1-42be-a276-e69eb42cdff0 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:47.208970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f47c7896-5e8c-4ce1-90fc-59602a35898b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609b09cc9c7646d8baa986148b6e832f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:47.214005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:47.214719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:47.215083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:47.215423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:47.216272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:47.218468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:47.235518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 826/1637] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:47.236559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:47.239263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:47.239778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 812/1638] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:45:46 2022] DELETE /identity/v3/users/609b09cc9c7646d8baa986148b6e832f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:47.241279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab53a28-5604-483f-95e2-fe5479e8eaf1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:47.241582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab53a28-5604-483f-95e2-fe5479e8eaf1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:47.241844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab53a28-5604-483f-95e2-fe5479e8eaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:47.302469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-1ab53a28-5604-483f-95e2-fe5479e8eaf1 None None] MFA Rules not processed for user `f1fb19b957574f4b80736fce35ab26bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:47.303691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1ab53a28-5604-483f-95e2-fe5479e8eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:47.331504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5c00-8897-4202-aa56-ae4f200cbb2f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:47.411333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:47.432269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:47.433598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:47.433944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:47.434294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:47.437892 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:47.447679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 813/1639] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:47.448900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab53a28-5604-483f-95e2-fe5479e8eaf1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:47.459850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1ab53a28-5604-483f-95e2-fe5479e8eaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:47.518190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:47.585057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:47.587669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:47.608915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 827/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:47.610328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:47.612502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:47.634917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab53a28-5604-483f-95e2-fe5479e8eaf1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:47.649107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ddb21-5e29-4a83-ae20-9bc2ea45d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:47.650299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddb21-5e29-4a83-ae20-9bc2ea45d3cb admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:47.650299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddb21-5e29-4a83-ae20-9bc2ea45d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:47.650299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ddb21-5e29-4a83-ae20-9bc2ea45d3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:47.651154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ddb21-5e29-4a83-ae20-9bc2ea45d3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:47.654527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ddb21-5e29-4a83-ae20-9bc2ea45d3cb admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:47.669817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48c299-25b3-48d6-94a1-d971144bd0a7 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:47.676436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8fbfc-7693-470f-8796-e3d7bcf7c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:47.677501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8fbfc-7693-470f-8796-e3d7bcf7c99d admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:47.677501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8fbfc-7693-470f-8796-e3d7bcf7c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:47.677682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8fbfc-7693-470f-8796-e3d7bcf7c99d admin admin] PATH_INFO: `/v3/projects/fd43f6bd8823456c90c15b6343eb7aa2/users/6fd65215187a40e7adefe52b68d6d3f4/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:47.687134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 814/1641] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:47.690117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083ac4b-63dd-4369-bd8c-93d95a2f23b1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:47.690656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083ac4b-63dd-4369-bd8c-93d95a2f23b1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:47.691133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083ac4b-63dd-4369-bd8c-93d95a2f23b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:47.739194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8fbfc-7693-470f-8796-e3d7bcf7c99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd43f6bd8823456c90c15b6343eb7aa2, user_id=6fd65215187a40e7adefe52b68d6d3f4, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:47.741977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8fbfc-7693-470f-8796-e3d7bcf7c99d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:47.757848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e083ac4b-63dd-4369-bd8c-93d95a2f23b1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:47.759697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e083ac4b-63dd-4369-bd8c-93d95a2f23b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:47.780788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 815/1642] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:47.786049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083ac4b-63dd-4369-bd8c-93d95a2f23b1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:47.787569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e083ac4b-63dd-4369-bd8c-93d95a2f23b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:47.789432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 828/1643] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:47 2022] PUT /identity/v3/projects/fd43f6bd8823456c90c15b6343eb7aa2/users/6fd65215187a40e7adefe52b68d6d3f4/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:47.790979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8fbfc-7693-470f-8796-e3d7bcf7c99d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:47.960637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8fbfc-7693-470f-8796-e3d7bcf7c99d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:47.965866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d134a-2fbd-4411-b3ca-8c424bc74356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:47.966610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d134a-2fbd-4411-b3ca-8c424bc74356 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:47.967768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d134a-2fbd-4411-b3ca-8c424bc74356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:47.968205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d134a-2fbd-4411-b3ca-8c424bc74356 admin admin] PATH_INFO: `/v3/projects/1d1992e2ee6544c3969102e7c7c245bf/users/db42ebc7be5b4e9080d26cf3cb5603ef/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:47.970349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d134a-2fbd-4411-b3ca-8c424bc74356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1992e2ee6544c3969102e7c7c245bf, user_id=db42ebc7be5b4e9080d26cf3cb5603ef, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:47.973227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d134a-2fbd-4411-b3ca-8c424bc74356 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:47.976013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083ac4b-63dd-4369-bd8c-93d95a2f23b1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:48.004755 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 829/1644] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:47 2022] PUT /identity/v3/projects/1d1992e2ee6544c3969102e7c7c245bf/users/db42ebc7be5b4e9080d26cf3cb5603ef/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:48.005871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d134a-2fbd-4411-b3ca-8c424bc74356 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:48.169195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21b7a4-b84d-4bd3-9258-681bfe9cf209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:48.169840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b7a4-b84d-4bd3-9258-681bfe9cf209 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.172745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b7a4-b84d-4bd3-9258-681bfe9cf209 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.173705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21b7a4-b84d-4bd3-9258-681bfe9cf209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.245690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d134a-2fbd-4411-b3ca-8c424bc74356 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:48.264568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:48.265272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.265565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.265842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.267789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:48.272019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:48.328430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 830/1645] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:48.328430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:48.335742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21b7a4-b84d-4bd3-9258-681bfe9cf209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:48.336588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21b7a4-b84d-4bd3-9258-681bfe9cf209 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:48.337557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:48.382000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:48.385521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 816/1646] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:48.387533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61837de-4d8f-4912-9aa2-336d98575dae None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.391106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61837de-4d8f-4912-9aa2-336d98575dae None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.395155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61837de-4d8f-4912-9aa2-336d98575dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.522262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b61837de-4d8f-4912-9aa2-336d98575dae None None] MFA Rules not processed for user `db42ebc7be5b4e9080d26cf3cb5603ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:48.523514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b61837de-4d8f-4912-9aa2-336d98575dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:48.537723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:48.553300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a9e21-6df0-470a-b894-cbf825671148 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:48.562645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44acd8-ea66-43e7-9e6e-768c5562b46a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:48.564932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44acd8-ea66-43e7-9e6e-768c5562b46a service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.565227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44acd8-ea66-43e7-9e6e-768c5562b46a service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.565472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44acd8-ea66-43e7-9e6e-768c5562b46a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.594292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44acd8-ea66-43e7-9e6e-768c5562b46a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:48.600559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44acd8-ea66-43e7-9e6e-768c5562b46a service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:48.623760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 831/1647] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:48.625225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2631-9cbc-4365-bef4-d4d01295878c None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.625514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2631-9cbc-4365-bef4-d4d01295878c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.625790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e2631-9cbc-4365-bef4-d4d01295878c None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.627100 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 832/1648] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 31 09:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:45:48.632198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e2631-9cbc-4365-bef4-d4d01295878c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:48.670687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e2631-9cbc-4365-bef4-d4d01295878c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:48.684448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a384a5-2c7c-450a-91b3-6253b2a170dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:48.685138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a384a5-2c7c-450a-91b3-6253b2a170dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.685420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a384a5-2c7c-450a-91b3-6253b2a170dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.686240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a384a5-2c7c-450a-91b3-6253b2a170dc admin admin] PATH_INFO: `/v3/projects/fd43f6bd8823456c90c15b6343eb7aa2/users/6fd65215187a40e7adefe52b68d6d3f4/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.691043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a384a5-2c7c-450a-91b3-6253b2a170dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd43f6bd8823456c90c15b6343eb7aa2, user_id=6fd65215187a40e7adefe52b68d6d3f4, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:48.693880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a384a5-2c7c-450a-91b3-6253b2a170dc admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:48.710592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 817/1649] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:48.711497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61837de-4d8f-4912-9aa2-336d98575dae None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:48.727131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 833/1650] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:48 2022] PUT /identity/v3/projects/fd43f6bd8823456c90c15b6343eb7aa2/users/6fd65215187a40e7adefe52b68d6d3f4/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:48.727131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889d46-2b7b-43fa-a817-92e52a108bf8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.727131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889d46-2b7b-43fa-a817-92e52a108bf8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.727131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04889d46-2b7b-43fa-a817-92e52a108bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.771305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-04889d46-2b7b-43fa-a817-92e52a108bf8 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:48.777079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-04889d46-2b7b-43fa-a817-92e52a108bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:48.844971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61837de-4d8f-4912-9aa2-336d98575dae None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:48.941227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 834/1651] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:45:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:48.942710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99df6-5d3d-441c-8b8b-eb9c8f88e0f0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.942998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99df6-5d3d-441c-8b8b-eb9c8f88e0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.943273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b99df6-5d3d-441c-8b8b-eb9c8f88e0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.955193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:48.955824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:48.956104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:48.956404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:48.962768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:49.016593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-68b99df6-5d3d-441c-8b8b-eb9c8f88e0f0 None None] MFA Rules not processed for user `6fd65215187a40e7adefe52b68d6d3f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:49.017847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-68b99df6-5d3d-441c-8b8b-eb9c8f88e0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:49.091208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:49.092872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:49.112182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 818/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:49.113079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:49.121393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:49.127738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 835/1653] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:49.141899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b28432-0adf-4559-b914-7081e360e28c service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:49.146302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a64fa5-701e-4097-b557-f9d43bcf7a22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:49.147789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a64fa5-701e-4097-b557-f9d43bcf7a22 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:49.148139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a64fa5-701e-4097-b557-f9d43bcf7a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:49.148530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a64fa5-701e-4097-b557-f9d43bcf7a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:49.159035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:49.238744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a64fa5-701e-4097-b557-f9d43bcf7a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:49.240616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a64fa5-701e-4097-b557-f9d43bcf7a22 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:49.255687 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 819/1654] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:49.359497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b99df6-5d3d-441c-8b8b-eb9c8f88e0f0 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:49.379125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b99df6-5d3d-441c-8b8b-eb9c8f88e0f0 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:49.401357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:49.402879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:49.405441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:49.406297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:49.441289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:49.446640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:49.495505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 836/1655] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:49.613947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a64fa5-701e-4097-b557-f9d43bcf7a22 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:49.627745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a64fa5-701e-4097-b557-f9d43bcf7a22 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:49.639565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:49.640224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:49.642496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:49.642806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:49.649480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:49.846478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:49.852615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:49.859162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:49.861029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:49.870754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:49.884519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 820/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:50.094925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cebe2e-2b3a-4e38-83f0-629a212e141f service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:50.104018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:50.104908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:50.105290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:50.105691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] PATH_INFO: `/v3/projects/a24d29ac9ce244558ed7f464ea4f4168` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:50.109381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a24d29ac9ce244558ed7f464ea4f4168)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:50.110752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: WARNING py.warnings [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 09:45:50.110752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: warnings.warn(msg) Aug 31 09:45:50.110752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: Aug 31 09:45:50.121361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:50.255484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a24d29ac9ce244558ed7f464ea4f4168', 'request_id': 'req-181420ff-3572-4bac-a976-61c1e3ae0a46'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.269234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a24d29ac9ce244558ed7f464ea4f4168', 'request_id': 'req-181420ff-3572-4bac-a976-61c1e3ae0a46'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.288527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a24d29ac9ce244558ed7f464ea4f4168', 'request_id': 'req-181420ff-3572-4bac-a976-61c1e3ae0a46'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.314546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] The token cache is being invalidate because project a24d29ac9ce244558ed7f464ea4f4168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:45:50.315247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.316188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.318549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 837/1657] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:45:49 2022] DELETE /identity/v3/projects/a24d29ac9ce244558ed7f464ea4f4168 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:50.323498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:50.346580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a9809-a4fe-45c3-a806-3c9b0beaf319 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:50.509861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:50.512402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:50.514033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:50.529739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] PATH_INFO: `/v3/users/b7498b9528a74158b4a2e784c2d6fde6` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:50.535805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7498b9528a74158b4a2e784c2d6fde6)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:50.539127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:50.666349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:50.674975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7498b9528a74158b4a2e784c2d6fde6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.719796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7498b9528a74158b4a2e784c2d6fde6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.721723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7498b9528a74158b4a2e784c2d6fde6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.731048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:50.733130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7498b9528a74158b4a2e784c2d6fde6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.733397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:50.756808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-78f469e3-8f9c-4c51-8181-7ca22bcb7dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7498b9528a74158b4a2e784c2d6fde6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:50.786934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 821/1658] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:45:50 2022] DELETE /identity/v3/users/b7498b9528a74158b4a2e784c2d6fde6 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:50.956656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181420ff-3572-4bac-a976-61c1e3ae0a46 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:51.131708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:51.144359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8050556-a322-4290-9a04-cec0f05094e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:51.144998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050556-a322-4290-9a04-cec0f05094e2 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:51.145277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050556-a322-4290-9a04-cec0f05094e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:51.145549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8050556-a322-4290-9a04-cec0f05094e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:51.147466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e8050556-a322-4290-9a04-cec0f05094e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:51.356436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8050556-a322-4290-9a04-cec0f05094e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:51.362009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8050556-a322-4290-9a04-cec0f05094e2 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:51.420214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 838/1659] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 688 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:51.654718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9df0-68b0-4be0-a7a4-f2b4ebfb516d None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:51.655092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9df0-68b0-4be0-a7a4-f2b4ebfb516d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:51.655348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc9df0-68b0-4be0-a7a4-f2b4ebfb516d None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:51.657436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 822/1660] 10.222.0.18 () {54 vars in 962 bytes} [Wed Aug 31 09:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:45:51.681189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342671-6081-4f99-b7e0-cddc1a45dba2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:51.681906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342671-6081-4f99-b7e0-cddc1a45dba2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:51.682321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a342671-6081-4f99-b7e0-cddc1a45dba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:51.721912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3a342671-6081-4f99-b7e0-cddc1a45dba2 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:51.723150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3a342671-6081-4f99-b7e0-cddc1a45dba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:51.841082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 839/1661] 10.222.0.18 () {58 vars in 1059 bytes} [Wed Aug 31 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:51.846975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaf484-4432-4a3c-af02-e5050e944ad8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:51.847828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaf484-4432-4a3c-af02-e5050e944ad8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:51.848522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aaf484-4432-4a3c-af02-e5050e944ad8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:51.850071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 823/1662] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 31 09:45:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:45:51.859176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52fc84-8317-436a-af5c-004c1def8a35 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:51.861382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52fc84-8317-436a-af5c-004c1def8a35 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:51.861951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52fc84-8317-436a-af5c-004c1def8a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:51.937239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-fa52fc84-8317-436a-af5c-004c1def8a35 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:51.938564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fa52fc84-8317-436a-af5c-004c1def8a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:51.963903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 840/1663] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:45:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:52.239079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaf484-4432-4a3c-af02-e5050e944ad8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:52.245813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-51aaf484-4432-4a3c-af02-e5050e944ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:52.288089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aaf484-4432-4a3c-af02-e5050e944ad8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:52.299609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77642157-f883-43e3-9f68-745d36da3d5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:52.302548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77642157-f883-43e3-9f68-745d36da3d5e service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:52.302917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77642157-f883-43e3-9f68-745d36da3d5e service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:52.303267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77642157-f883-43e3-9f68-745d36da3d5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:52.329178 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77642157-f883-43e3-9f68-745d36da3d5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:52.330875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77642157-f883-43e3-9f68-745d36da3d5e service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:52.362256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 824/1664] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:52.426065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52fc84-8317-436a-af5c-004c1def8a35 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:52.427857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fa52fc84-8317-436a-af5c-004c1def8a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:52.495557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d4e45-4697-481d-ae28-2132019838d4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:52.495982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d4e45-4697-481d-ae28-2132019838d4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:52.496365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d4e45-4697-481d-ae28-2132019838d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:52.563075 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d45d4e45-4697-481d-ae28-2132019838d4 None None] MFA Rules not processed for user `9f8b22bc870c4341b48d83e2e5821372`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:52.564371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d45d4e45-4697-481d-ae28-2132019838d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:52.698195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52fc84-8317-436a-af5c-004c1def8a35 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:52.710736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:52.711760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:52.712329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:52.712835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] PATH_INFO: `/v3/projects/d33c42c2f1764e18960dcc3c564f68c9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:52.719552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d33c42c2f1764e18960dcc3c564f68c9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:52.721624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:52.866301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 825/1665] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:52.883238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9eeed-dec9-41b2-80fa-fd33d44b5bf5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:52.884039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9eeed-dec9-41b2-80fa-fd33d44b5bf5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:52.884498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df9eeed-dec9-41b2-80fa-fd33d44b5bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:52.900255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:52.924133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4df9eeed-dec9-41b2-80fa-fd33d44b5bf5 None None] MFA Rules not processed for user `9f8b22bc870c4341b48d83e2e5821372`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:52.940768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4df9eeed-dec9-41b2-80fa-fd33d44b5bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:52.971038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd33c42c2f1764e18960dcc3c564f68c9', 'request_id': 'req-e6a73585-2aa0-49e1-b8e9-2061f1553898'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:52.995337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd33c42c2f1764e18960dcc3c564f68c9', 'request_id': 'req-e6a73585-2aa0-49e1-b8e9-2061f1553898'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:53.011507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd33c42c2f1764e18960dcc3c564f68c9', 'request_id': 'req-e6a73585-2aa0-49e1-b8e9-2061f1553898'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:53.042219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] The token cache is being invalidate because project d33c42c2f1764e18960dcc3c564f68c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:45:53.042526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:53.046506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e6a73585-2aa0-49e1-b8e9-2061f1553898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:53.048829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 841/1666] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:45:52 2022] DELETE /identity/v3/projects/d33c42c2f1764e18960dcc3c564f68c9 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:53.054591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e92e4-e7b3-4eb1-9794-346e5b064589 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:53.054928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e92e4-e7b3-4eb1-9794-346e5b064589 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:53.055232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e92e4-e7b3-4eb1-9794-346e5b064589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:53.091480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 826/1667] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:53.104009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9eeed-dec9-41b2-80fa-fd33d44b5bf5 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:53.105865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4df9eeed-dec9-41b2-80fa-fd33d44b5bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:53.137390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bb3e92e4-e7b3-4eb1-9794-346e5b064589 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:53.139481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bb3e92e4-e7b3-4eb1-9794-346e5b064589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:53.213979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:53.275804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df9eeed-dec9-41b2-80fa-fd33d44b5bf5 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:53.283264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 842/1668] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:53.284518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e92e4-e7b3-4eb1-9794-346e5b064589 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:53.285172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3726-b76c-4360-bc51-024b57fa5cf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:53.285939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3726-b76c-4360-bc51-024b57fa5cf6 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:53.286372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3726-b76c-4360-bc51-024b57fa5cf6 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:53.286611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bb3e92e4-e7b3-4eb1-9794-346e5b064589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:53.288164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3726-b76c-4360-bc51-024b57fa5cf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:53.295661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ae6f3726-b76c-4360-bc51-024b57fa5cf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:53.317584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f3726-b76c-4360-bc51-024b57fa5cf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:53.319335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f3726-b76c-4360-bc51-024b57fa5cf6 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:53.353600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 827/1669] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:53.355250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c2b7-5ae7-4f26-a431-484e1c0e7b53 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:53.360122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c2b7-5ae7-4f26-a431-484e1c0e7b53 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:53.360690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c2b7-5ae7-4f26-a431-484e1c0e7b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:53.407502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a6b8c2b7-5ae7-4f26-a431-484e1c0e7b53 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:53.409491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a6b8c2b7-5ae7-4f26-a431-484e1c0e7b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:53.432049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e92e4-e7b3-4eb1-9794-346e5b064589 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:53.434997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 828/1670] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:53.437448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:53.438373 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:53.438725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:53.438910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:53.440025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c2b7-5ae7-4f26-a431-484e1c0e7b53 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:53.441057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:53.456832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c2b7-5ae7-4f26-a431-484e1c0e7b53 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:53.479143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:53.479985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:53.480454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:53.481028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:53.481802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:53.482256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:53.484545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:53.512789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 829/1671] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:53.515719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:53.561125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3274b-296d-4cc4-884f-3fddb112d7f5 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:53.582597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:53.584067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:53.586559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d1d7a-9f7f-4dfd-8847-d80592426e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:53.587114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1d7a-9f7f-4dfd-8847-d80592426e4c admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:53.589222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1d7a-9f7f-4dfd-8847-d80592426e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:53.589222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d1d7a-9f7f-4dfd-8847-d80592426e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:53.589222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d1d7a-9f7f-4dfd-8847-d80592426e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:53.590447 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d1d7a-9f7f-4dfd-8847-d80592426e4c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:53.614335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 843/1672] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:53.684276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 830/1673] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:53 2022] POST /identity/v3/projects => generated 363 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:53.689174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:53.718979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b3833-e217-4f12-aab9-984d17532033 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:53.740560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:53.887236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07673-f735-4bbe-86c5-0d2b01f30f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:53.888121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07673-f735-4bbe-86c5-0d2b01f30f94 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:53.890606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07673-f735-4bbe-86c5-0d2b01f30f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:53.891059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07673-f735-4bbe-86c5-0d2b01f30f94 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:53.891862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf07673-f735-4bbe-86c5-0d2b01f30f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:53.894166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf07673-f735-4bbe-86c5-0d2b01f30f94 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:53.974373 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 844/1674] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:53 2022] POST /identity/v3/users => generated 282 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:53.975620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d1d7a-9f7f-4dfd-8847-d80592426e4c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:53.992004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d1d7a-9f7f-4dfd-8847-d80592426e4c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:54.023927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb55b2-f9e9-4e92-a381-6c7c4554a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:54.025678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb55b2-f9e9-4e92-a381-6c7c4554a473 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.025971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb55b2-f9e9-4e92-a381-6c7c4554a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.030832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb55b2-f9e9-4e92-a381-6c7c4554a473 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.031638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb55b2-f9e9-4e92-a381-6c7c4554a473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:54.033545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb55b2-f9e9-4e92-a381-6c7c4554a473 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:54.057358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 831/1675] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:54.061512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07673-f735-4bbe-86c5-0d2b01f30f94 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:54.080953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07673-f735-4bbe-86c5-0d2b01f30f94 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:54.102306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:54.102959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.103220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.103572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.104305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:54.106034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:54.136019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 845/1676] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:54.141176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb55b2-f9e9-4e92-a381-6c7c4554a473 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:54.151558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:54.153347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:54.170772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb55b2-f9e9-4e92-a381-6c7c4554a473 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:54.191456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2367b-8e2b-43b8-b4f7-caeeef337f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:54.192135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2367b-8e2b-43b8-b4f7-caeeef337f73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.192443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2367b-8e2b-43b8-b4f7-caeeef337f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.192714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2367b-8e2b-43b8-b4f7-caeeef337f73 admin admin] PATH_INFO: `/v3/projects/a99d7cea19ee4e3eb1d0d1a321c5086e/users/c1665b6c5f1c4184b89aefc6b76f8a88/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.194757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf617a0-7c73-4a0d-8001-431f7e4cbe61 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:54.222534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:54.223195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.223481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.230691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] PATH_INFO: `/v3/users/4e9b6afdd0644537a0b69799fc0e34fa` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.237114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9b6afdd0644537a0b69799fc0e34fa)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:54.239033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:54.261374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2367b-8e2b-43b8-b4f7-caeeef337f73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99d7cea19ee4e3eb1d0d1a321c5086e, user_id=c1665b6c5f1c4184b89aefc6b76f8a88, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:54.265859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2367b-8e2b-43b8-b4f7-caeeef337f73 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:54.328383 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 832/1677] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:54 2022] PUT /identity/v3/projects/a99d7cea19ee4e3eb1d0d1a321c5086e/users/c1665b6c5f1c4184b89aefc6b76f8a88/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:54.330226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fc15-2180-4506-821d-12ec63c4d1ef None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.330627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fc15-2180-4506-821d-12ec63c4d1ef None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.330947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448fc15-2180-4506-821d-12ec63c4d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.404466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9b6afdd0644537a0b69799fc0e34fa'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:54.408311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9b6afdd0644537a0b69799fc0e34fa'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:54.420201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6448fc15-2180-4506-821d-12ec63c4d1ef None None] MFA Rules not processed for user `c1665b6c5f1c4184b89aefc6b76f8a88`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:54.421507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6448fc15-2180-4506-821d-12ec63c4d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:54.470052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9b6afdd0644537a0b69799fc0e34fa'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:54.522978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9b6afdd0644537a0b69799fc0e34fa'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:54.557750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5b1fbf66-da48-441f-b8be-4b63c89d242a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9b6afdd0644537a0b69799fc0e34fa'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:54.581012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 846/1678] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:45:54 2022] DELETE /identity/v3/users/4e9b6afdd0644537a0b69799fc0e34fa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:54.585124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb92a2-6fee-4534-981b-8a0f53c80568 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.585423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb92a2-6fee-4534-981b-8a0f53c80568 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.585709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb92a2-6fee-4534-981b-8a0f53c80568 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.589040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 847/1679] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 31 09:45:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:45:54.594040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370f67-6071-44e2-a2b3-28e54d46291b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.596186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370f67-6071-44e2-a2b3-28e54d46291b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.598233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad370f67-6071-44e2-a2b3-28e54d46291b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.617666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 833/1680] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:54.619237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d719-9f08-4f9f-a786-b7f5db82a362 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.619533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d719-9f08-4f9f-a786-b7f5db82a362 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.619810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317d719-9f08-4f9f-a786-b7f5db82a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.652440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ad370f67-6071-44e2-a2b3-28e54d46291b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:54.654054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ad370f67-6071-44e2-a2b3-28e54d46291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:54.687054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6317d719-9f08-4f9f-a786-b7f5db82a362 None None] MFA Rules not processed for user `886e718c9d7d48aa8655b8993e2af945`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:54.690835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6317d719-9f08-4f9f-a786-b7f5db82a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:54.745628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:54.800189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 834/1681] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:54.801393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317d719-9f08-4f9f-a786-b7f5db82a362 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:54.806475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6317d719-9f08-4f9f-a786-b7f5db82a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:54.827502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:54.867180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 848/1682] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:54.867856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad370f67-6071-44e2-a2b3-28e54d46291b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:54.870760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ad370f67-6071-44e2-a2b3-28e54d46291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:54.910176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad370f67-6071-44e2-a2b3-28e54d46291b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:54.919083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b873931-835e-4dc9-bf80-012601859cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:54.921539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b873931-835e-4dc9-bf80-012601859cdb service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:54.923758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b873931-835e-4dc9-bf80-012601859cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:54.928862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b873931-835e-4dc9-bf80-012601859cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:54.956732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b873931-835e-4dc9-bf80-012601859cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:54.965544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b873931-835e-4dc9-bf80-012601859cdb service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:54.992062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 849/1683] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:54.995086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b873931-835e-4dc9-bf80-012601859cdb service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:55.027183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b873931-835e-4dc9-bf80-012601859cdb service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:55.028313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317d719-9f08-4f9f-a786-b7f5db82a362 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:55.033017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bda7b-efe4-4b14-b9cb-5bdb81c8e3e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:55.033680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bda7b-efe4-4b14-b9cb-5bdb81c8e3e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:55.033966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bda7b-efe4-4b14-b9cb-5bdb81c8e3e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:55.034868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650bda7b-efe4-4b14-b9cb-5bdb81c8e3e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:55.036777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd8b7d-3c8b-4eb7-a661-111258dcce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:55.037416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8b7d-3c8b-4eb7-a661-111258dcce4e admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:55.037697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8b7d-3c8b-4eb7-a661-111258dcce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:55.038107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd8b7d-3c8b-4eb7-a661-111258dcce4e admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:55.038765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd8b7d-3c8b-4eb7-a661-111258dcce4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:55.043049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd8b7d-3c8b-4eb7-a661-111258dcce4e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:55.053974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bda7b-efe4-4b14-b9cb-5bdb81c8e3e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:55.055464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650bda7b-efe4-4b14-b9cb-5bdb81c8e3e4 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:55.084102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 850/1684] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:55.124326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 835/1685] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:54 2022] POST /identity/v3/projects => generated 363 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:55.128755 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bda7b-efe4-4b14-b9cb-5bdb81c8e3e4 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:55.142505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650bda7b-efe4-4b14-b9cb-5bdb81c8e3e4 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:55.268637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc2237-3708-449e-9482-9f16d35e6997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:55.269257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2237-3708-449e-9482-9f16d35e6997 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:55.269829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2237-3708-449e-9482-9f16d35e6997 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:55.270158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efc2237-3708-449e-9482-9f16d35e6997 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:55.270811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc2237-3708-449e-9482-9f16d35e6997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:55.274481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efc2237-3708-449e-9482-9f16d35e6997 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:55.329894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 851/1686] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:55 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:55.330680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd8b7d-3c8b-4eb7-a661-111258dcce4e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:55.346109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd8b7d-3c8b-4eb7-a661-111258dcce4e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:55.361076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e23e6-9b3c-4c8f-aa80-a25d157b458f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:55.361705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e23e6-9b3c-4c8f-aa80-a25d157b458f admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:55.361987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e23e6-9b3c-4c8f-aa80-a25d157b458f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:55.362257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e23e6-9b3c-4c8f-aa80-a25d157b458f admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:55.362916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e23e6-9b3c-4c8f-aa80-a25d157b458f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:55.367175 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e23e6-9b3c-4c8f-aa80-a25d157b458f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:55.405049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 836/1687] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:55.409047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc2237-3708-449e-9482-9f16d35e6997 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:55.423203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efc2237-3708-449e-9482-9f16d35e6997 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:55.434027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e4ca0-564a-430a-b21d-6b846b5a2a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:55.434716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e4ca0-564a-430a-b21d-6b846b5a2a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:55.434999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e4ca0-564a-430a-b21d-6b846b5a2a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:55.435345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e4ca0-564a-430a-b21d-6b846b5a2a1f admin admin] PATH_INFO: `/v3/projects/a53c6130d2954f5bbd5a20375fe3a7ea/users/dce5fca421e0499dad3adccce4390ae9/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:55.483469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e4ca0-564a-430a-b21d-6b846b5a2a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53c6130d2954f5bbd5a20375fe3a7ea, user_id=dce5fca421e0499dad3adccce4390ae9, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:55.488085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3e4ca0-564a-430a-b21d-6b846b5a2a1f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:55.522702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 852/1688] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:55 2022] PUT /identity/v3/projects/a53c6130d2954f5bbd5a20375fe3a7ea/users/dce5fca421e0499dad3adccce4390ae9/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:55.527005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e23e6-9b3c-4c8f-aa80-a25d157b458f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:55.545665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e23e6-9b3c-4c8f-aa80-a25d157b458f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:55.763986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b35bd2a-f9f5-4522-b220-02a9047e9f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:55.773620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35bd2a-f9f5-4522-b220-02a9047e9f4a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:55.774259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35bd2a-f9f5-4522-b220-02a9047e9f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:55.774697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b35bd2a-f9f5-4522-b220-02a9047e9f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:55.775689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35bd2a-f9f5-4522-b220-02a9047e9f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:55.777638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b35bd2a-f9f5-4522-b220-02a9047e9f4a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:55.803385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 837/1689] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:55 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:55.806625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e4ca0-564a-430a-b21d-6b846b5a2a1f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:55.819286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e4ca0-564a-430a-b21d-6b846b5a2a1f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:55.824065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:55.824872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:55.825056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:55.825401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] PATH_INFO: `/v3/projects/a53c6130d2954f5bbd5a20375fe3a7ea/users/dce5fca421e0499dad3adccce4390ae9/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:55.827490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53c6130d2954f5bbd5a20375fe3a7ea, user_id=dce5fca421e0499dad3adccce4390ae9, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:55.830623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:55.844456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 853/1690] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:55 2022] PUT /identity/v3/projects/a53c6130d2954f5bbd5a20375fe3a7ea/users/dce5fca421e0499dad3adccce4390ae9/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:55.854795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934576-0911-46e0-8c3a-8c440ee198a2 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:55.855089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934576-0911-46e0-8c3a-8c440ee198a2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:55.855649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68934576-0911-46e0-8c3a-8c440ee198a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:55.905729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:55.908634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:55.929331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-68934576-0911-46e0-8c3a-8c440ee198a2 None None] MFA Rules not processed for user `dce5fca421e0499dad3adccce4390ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:55.932379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-68934576-0911-46e0-8c3a-8c440ee198a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:56.059686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:56.123566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd310e8-a9cc-4628-9f63-7de24d5d79b1 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:56.145344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:56.146055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:56.146424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:56.146691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] PATH_INFO: `/v3/projects/e02ba702c6f34372b26fa0a55893242b` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:56.148464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e02ba702c6f34372b26fa0a55893242b)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:56.148815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 838/1691] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:56.150769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:56.274413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:56.308541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68934576-0911-46e0-8c3a-8c440ee198a2 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:56.310974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-68934576-0911-46e0-8c3a-8c440ee198a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:56.319626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e02ba702c6f34372b26fa0a55893242b', 'request_id': 'req-648d35a7-3110-4fd0-baef-f8b12d84523f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:56.334523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e02ba702c6f34372b26fa0a55893242b', 'request_id': 'req-648d35a7-3110-4fd0-baef-f8b12d84523f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:56.347273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e02ba702c6f34372b26fa0a55893242b', 'request_id': 'req-648d35a7-3110-4fd0-baef-f8b12d84523f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:56.376978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] The token cache is being invalidate because project e02ba702c6f34372b26fa0a55893242b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:45:56.377430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:56.379673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:56.382495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 854/1692] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:45:55 2022] DELETE /identity/v3/projects/e02ba702c6f34372b26fa0a55893242b => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:45:56.384200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:56.386438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:56.457452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68934576-0911-46e0-8c3a-8c440ee198a2 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:56.525704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d35a7-3110-4fd0-baef-f8b12d84523f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:56.534003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178a0125-5615-4fff-babb-dcf3e105bb8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:56.535602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a0125-5615-4fff-babb-dcf3e105bb8e service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:56.535967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a0125-5615-4fff-babb-dcf3e105bb8e service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:56.536343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178a0125-5615-4fff-babb-dcf3e105bb8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:56.546598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-178a0125-5615-4fff-babb-dcf3e105bb8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:56.579355 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a0125-5615-4fff-babb-dcf3e105bb8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:56.582421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178a0125-5615-4fff-babb-dcf3e105bb8e service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:56.617576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 855/1693] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:56.619607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7dad5-f67f-4f37-84f2-7a8abc6a72b5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:56.620937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7dad5-f67f-4f37-84f2-7a8abc6a72b5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:56.624778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cd079-9e74-41bd-93c0-a0b702291037 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:56.625530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd079-9e74-41bd-93c0-a0b702291037 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:56.625859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd079-9e74-41bd-93c0-a0b702291037 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:56.626365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cd079-9e74-41bd-93c0-a0b702291037 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:56.627409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7dad5-f67f-4f37-84f2-7a8abc6a72b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:56.629734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8b1cd079-9e74-41bd-93c0-a0b702291037 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:56.683095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c0d7dad5-f67f-4f37-84f2-7a8abc6a72b5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:56.684553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c0d7dad5-f67f-4f37-84f2-7a8abc6a72b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:56.823822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd079-9e74-41bd-93c0-a0b702291037 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:56.827603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cd079-9e74-41bd-93c0-a0b702291037 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:56.874543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 839/1694] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:45:56.901055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 856/1695] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:56.910387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f63ff-668e-4e78-8303-4be3e0e98149 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:56.910808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f63ff-668e-4e78-8303-4be3e0e98149 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:56.911160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f63ff-668e-4e78-8303-4be3e0e98149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:56.984454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-127f63ff-668e-4e78-8303-4be3e0e98149 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:56.990301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-127f63ff-668e-4e78-8303-4be3e0e98149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:57.027761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 840/1696] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:57.031432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7dad5-f67f-4f37-84f2-7a8abc6a72b5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:57.052603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7dad5-f67f-4f37-84f2-7a8abc6a72b5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:57.069817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:57.072259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:57.072259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:57.074681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:57.077949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:45:57.078275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:57.087658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:57.140384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 857/1697] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:45:57.144954 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f63ff-668e-4e78-8303-4be3e0e98149 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:57.168916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f63ff-668e-4e78-8303-4be3e0e98149 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:57.181574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368712c-8e72-4862-b439-836d3a50bbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:57.182838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368712c-8e72-4862-b439-836d3a50bbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:57.183557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368712c-8e72-4862-b439-836d3a50bbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:57.183959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368712c-8e72-4862-b439-836d3a50bbb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:57.184729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368712c-8e72-4862-b439-836d3a50bbb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:57.187358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368712c-8e72-4862-b439-836d3a50bbb4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:57.285419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 841/1698] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:45:57 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:57.286190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:57.302893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d22b4-c54a-4492-b9a3-37da52ea12ac admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:57.385881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:57.464591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf8250-58d3-4117-bb18-7fd47c576453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:57.465248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8250-58d3-4117-bb18-7fd47c576453 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:57.465511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8250-58d3-4117-bb18-7fd47c576453 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:57.466172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf8250-58d3-4117-bb18-7fd47c576453 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:57.467857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf8250-58d3-4117-bb18-7fd47c576453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:57.472104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf8250-58d3-4117-bb18-7fd47c576453 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:57.559612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 858/1699] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:45:57 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:45:57.561449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368712c-8e72-4862-b439-836d3a50bbb4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:57.592099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368712c-8e72-4862-b439-836d3a50bbb4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:57.628671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac822a9-ee35-4c5a-bdbd-13585ac0777e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:57.631634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac822a9-ee35-4c5a-bdbd-13585ac0777e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:57.634643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac822a9-ee35-4c5a-bdbd-13585ac0777e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:57.635143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac822a9-ee35-4c5a-bdbd-13585ac0777e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:57.636214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac822a9-ee35-4c5a-bdbd-13585ac0777e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:57.640149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac822a9-ee35-4c5a-bdbd-13585ac0777e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:57.680085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:57.704738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 842/1700] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:57.712254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf8250-58d3-4117-bb18-7fd47c576453 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:57.719343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf8250-58d3-4117-bb18-7fd47c576453 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:57.735163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3039440-168e-40dc-bd7a-02a2e2d54130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:57.737459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039440-168e-40dc-bd7a-02a2e2d54130 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:57.737824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039440-168e-40dc-bd7a-02a2e2d54130 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:57.738111 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3039440-168e-40dc-bd7a-02a2e2d54130 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:57.741003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3039440-168e-40dc-bd7a-02a2e2d54130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:57.743925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3039440-168e-40dc-bd7a-02a2e2d54130 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:57.772786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac822a9-ee35-4c5a-bdbd-13585ac0777e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:57.785979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 859/1701] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:45:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:45:57.786803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac822a9-ee35-4c5a-bdbd-13585ac0777e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:57.801337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:57.802015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:57.802292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:57.803049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] PATH_INFO: `/v3/projects/c6e7d8b65bb042bca2533f47b90fe5bd/users/31f4061404654fe2808490e76d1a4dbc/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:57.850846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e7d8b65bb042bca2533f47b90fe5bd, user_id=31f4061404654fe2808490e76d1a4dbc, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:57.854896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:57.895942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 843/1702] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:45:57 2022] PUT /identity/v3/projects/c6e7d8b65bb042bca2533f47b90fe5bd/users/31f4061404654fe2808490e76d1a4dbc/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:45:57.909565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7228e2-19d2-4fdf-987d-de5e149d76e5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:57.910145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7228e2-19d2-4fdf-987d-de5e149d76e5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:57.910619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7228e2-19d2-4fdf-987d-de5e149d76e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:58.010145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:58.012556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:58.032245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0c7228e2-19d2-4fdf-987d-de5e149d76e5 None None] MFA Rules not processed for user `31f4061404654fe2808490e76d1a4dbc`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:58.038955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0c7228e2-19d2-4fdf-987d-de5e149d76e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:58.176872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8c9bf-2338-438f-87e5-823d08954994 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:58.194126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:58.194872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:58.195232 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:58.195585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] PATH_INFO: `/v3/users/c1665b6c5f1c4184b89aefc6b76f8a88` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:58.196881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1665b6c5f1c4184b89aefc6b76f8a88)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:58.198996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:58.265051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 860/1703] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:58.280236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7228e2-19d2-4fdf-987d-de5e149d76e5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:58.280236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0c7228e2-19d2-4fdf-987d-de5e149d76e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:58.324986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1665b6c5f1c4184b89aefc6b76f8a88'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:58.397264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1665b6c5f1c4184b89aefc6b76f8a88'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:58.400385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1665b6c5f1c4184b89aefc6b76f8a88'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:58.401250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1665b6c5f1c4184b89aefc6b76f8a88'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:58.431269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e8951285-a217-4a2b-b0a6-316c6c893cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1665b6c5f1c4184b89aefc6b76f8a88'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:58.474149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 844/1704] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:45:58 2022] DELETE /identity/v3/users/c1665b6c5f1c4184b89aefc6b76f8a88 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:45:58.484475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa7dc-ee1e-42ec-b1c2-250bb84f9168 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:58.484939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa7dc-ee1e-42ec-b1c2-250bb84f9168 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:58.485959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191fa7dc-ee1e-42ec-b1c2-250bb84f9168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:58.539352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7228e2-19d2-4fdf-987d-de5e149d76e5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:58.560861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-191fa7dc-ee1e-42ec-b1c2-250bb84f9168 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:45:58.565163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-191fa7dc-ee1e-42ec-b1c2-250bb84f9168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:58.715533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:58.786826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:45:58.835041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:58.845134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:58.845134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:58.845134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:58.848512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:58.853245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 845/1705] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:45:58.862587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa7dc-ee1e-42ec-b1c2-250bb84f9168 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:58.865055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-191fa7dc-ee1e-42ec-b1c2-250bb84f9168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:59.094046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191fa7dc-ee1e-42ec-b1c2-250bb84f9168 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:59.103495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:59.104715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:59.104998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:59.105289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:59.126207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:59.128759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:59.139655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:59.143943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:59.148422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 861/1706] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 876 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:59.215991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 846/1707] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:45:59.668305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:59.674670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:59.717842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64914e4-7ede-4cd4-92b6-5fd25a7b7ee2 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:59.740624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:59.741447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:59.741734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:59.742020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] PATH_INFO: `/v3/users/f683b4c8736f45649d9514d5635e9255` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:59.743302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f683b4c8736f45649d9514d5635e9255)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:59.746331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:59.885038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:45:59.886573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:45:59.894338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f683b4c8736f45649d9514d5635e9255'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:59.895499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f683b4c8736f45649d9514d5635e9255'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:59.913843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1de4e-824e-473f-9dd6-6ebaf19ca016 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:45:59.938326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f683b4c8736f45649d9514d5635e9255'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:45:59.940958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:45:59.942198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:45:59.942490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:45:59.942766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] PATH_INFO: `/v3/users/31f4061404654fe2808490e76d1a4dbc` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:45:59.946148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31f4061404654fe2808490e76d1a4dbc)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:45:59.948102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:45:59.976690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f683b4c8736f45649d9514d5635e9255'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:00.002027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-26f07094-ed49-401e-a77b-237b57ecf14d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f683b4c8736f45649d9514d5635e9255'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:00.024261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 862/1708] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:45:59 2022] DELETE /identity/v3/users/f683b4c8736f45649d9514d5635e9255 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:00.028063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304f8c6-1211-4bf5-a0df-89fc3359fc1f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:00.028395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304f8c6-1211-4bf5-a0df-89fc3359fc1f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:00.029062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304f8c6-1211-4bf5-a0df-89fc3359fc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:00.059209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f304f8c6-1211-4bf5-a0df-89fc3359fc1f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:00.062695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f304f8c6-1211-4bf5-a0df-89fc3359fc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:00.102453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31f4061404654fe2808490e76d1a4dbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:00.130936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31f4061404654fe2808490e76d1a4dbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:00.136890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31f4061404654fe2808490e76d1a4dbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:00.137794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31f4061404654fe2808490e76d1a4dbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:00.160328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-43080444-2012-448b-ae18-7ac18d3b7673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31f4061404654fe2808490e76d1a4dbc'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:00.186833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:00.205307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 847/1709] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:45:59 2022] DELETE /identity/v3/users/31f4061404654fe2808490e76d1a4dbc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:00.207476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4155a9-a37a-4084-87e3-69eb57c30654 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:00.208340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4155a9-a37a-4084-87e3-69eb57c30654 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:00.209711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4155a9-a37a-4084-87e3-69eb57c30654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:00.233392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 863/1710] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:00.233392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e6e0-8c15-4f2b-843f-cb9c6a204501 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:00.233392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e6e0-8c15-4f2b-843f-cb9c6a204501 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:00.233392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3e6e0-8c15-4f2b-843f-cb9c6a204501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:00.285793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-98b3e6e0-8c15-4f2b-843f-cb9c6a204501 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:00.287287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-98b3e6e0-8c15-4f2b-843f-cb9c6a204501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:00.310689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-fb4155a9-a37a-4084-87e3-69eb57c30654 None None] MFA Rules not processed for user `2f4f149b17ac48c4931338cc7b0b2112`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:00.312526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fb4155a9-a37a-4084-87e3-69eb57c30654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:00.432307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 864/1711] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:00.437097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e6e0-8c15-4f2b-843f-cb9c6a204501 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:00.444766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-98b3e6e0-8c15-4f2b-843f-cb9c6a204501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:00.451600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:00.471730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 848/1712] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:00.473350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158bc76-f028-4d05-aa29-6945b2fe6f85 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:00.473913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158bc76-f028-4d05-aa29-6945b2fe6f85 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:00.476580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158bc76-f028-4d05-aa29-6945b2fe6f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:00.534055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2158bc76-f028-4d05-aa29-6945b2fe6f85 None None] MFA Rules not processed for user `2f4f149b17ac48c4931338cc7b0b2112`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:00.537486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2158bc76-f028-4d05-aa29-6945b2fe6f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:00.557437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 849/1713] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:00 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:00.559913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158bc76-f028-4d05-aa29-6945b2fe6f85 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:00.565012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2158bc76-f028-4d05-aa29-6945b2fe6f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:00.591759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3e6e0-8c15-4f2b-843f-cb9c6a204501 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:00.595844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:00.596818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:00.597306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:00.597686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:00.614471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:00.629247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:00.670921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 865/1714] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:00.671931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:00.686168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:00.745156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158bc76-f028-4d05-aa29-6945b2fe6f85 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:00.757372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c80ee-0ec1-4e30-a86c-6024b9033487 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:00.758010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c80ee-0ec1-4e30-a86c-6024b9033487 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:00.758301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c80ee-0ec1-4e30-a86c-6024b9033487 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:00.758576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c80ee-0ec1-4e30-a86c-6024b9033487 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:00.786561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c80ee-0ec1-4e30-a86c-6024b9033487 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:00.788073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c80ee-0ec1-4e30-a86c-6024b9033487 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:00.834353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 850/1715] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:00.924944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66018a8f-0b9b-45d9-8435-16afc2e93d59 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:00.940150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:00.940991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:00.941098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:00.941346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:00.960929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:00.963397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:01.019656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 866/1716] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:00 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:01.128670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105770bd-2b03-4b55-a0af-73015faeae4c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:01.129381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105770bd-2b03-4b55-a0af-73015faeae4c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:01.129805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105770bd-2b03-4b55-a0af-73015faeae4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:01.250012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-105770bd-2b03-4b55-a0af-73015faeae4c None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:01.259092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-105770bd-2b03-4b55-a0af-73015faeae4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:01.317122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:01.318587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:01.356076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac54ec-8777-4c11-be17-2df5467c5495 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:01.374332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:01.379083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:01.379381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:01.379760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] PATH_INFO: `/v3/users/8ee69641352444a29bc7db558b3875bc` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:01.390492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee69641352444a29bc7db558b3875bc)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:01.396721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:01.453624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:01.465633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 851/1717] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:01.565120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee69641352444a29bc7db558b3875bc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:01.566219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee69641352444a29bc7db558b3875bc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:01.608806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee69641352444a29bc7db558b3875bc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:01.657773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee69641352444a29bc7db558b3875bc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:01.682704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee69641352444a29bc7db558b3875bc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:01.754763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028927a1-7e1e-4437-97ee-3e7d6147f455 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:01.755084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028927a1-7e1e-4437-97ee-3e7d6147f455 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:01.755734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028927a1-7e1e-4437-97ee-3e7d6147f455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:01.759435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 867/1718] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:01 2022] DELETE /identity/v3/users/8ee69641352444a29bc7db558b3875bc => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:01.770259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:01.778381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:01.858629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-028927a1-7e1e-4437-97ee-3e7d6147f455 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:01.859892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-028927a1-7e1e-4437-97ee-3e7d6147f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:02.030206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 852/1719] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:02.087305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700e6dc-0d7e-4165-8915-b98132150e8a admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:02.098322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931b5e9-599f-49d8-87ee-f4e73ac6440a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:02.099098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b5e9-599f-49d8-87ee-f4e73ac6440a service swift] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:02.099389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b5e9-599f-49d8-87ee-f4e73ac6440a service swift] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:02.099672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931b5e9-599f-49d8-87ee-f4e73ac6440a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:02.101591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e931b5e9-599f-49d8-87ee-f4e73ac6440a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:02.117088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028927a1-7e1e-4437-97ee-3e7d6147f455 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:02.118769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-028927a1-7e1e-4437-97ee-3e7d6147f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:02.147060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:02.282923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028927a1-7e1e-4437-97ee-3e7d6147f455 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:02.299667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:02.300125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:02.300480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:02.301078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:02.324265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:02.329162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:02.349862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b5e9-599f-49d8-87ee-f4e73ac6440a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:02.351531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 853/1720] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:02.361729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e931b5e9-599f-49d8-87ee-f4e73ac6440a service swift] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:02.392794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 868/1721] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:46:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:46:02.699491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:02.702398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:02.753654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c71397-5d8e-4854-b11d-b0eb88621e0e service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:02.780455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:02.781449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:02.781933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:02.782410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] PATH_INFO: `/v3/projects/c6e7d8b65bb042bca2533f47b90fe5bd` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:02.793809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e7d8b65bb042bca2533f47b90fe5bd)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:02.799373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:02.996922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e7d8b65bb042bca2533f47b90fe5bd', 'request_id': 'req-a4100975-162d-4e4f-8f4f-6b3fa282ece3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.022228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e7d8b65bb042bca2533f47b90fe5bd', 'request_id': 'req-a4100975-162d-4e4f-8f4f-6b3fa282ece3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.036356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e7d8b65bb042bca2533f47b90fe5bd', 'request_id': 'req-a4100975-162d-4e4f-8f4f-6b3fa282ece3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.079289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] The token cache is being invalidate because project c6e7d8b65bb042bca2533f47b90fe5bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:03.079595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.080578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a4100975-162d-4e4f-8f4f-6b3fa282ece3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.084529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 854/1722] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:02 2022] DELETE /identity/v3/projects/c6e7d8b65bb042bca2533f47b90fe5bd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:03.092836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7df772-8317-4e2d-b9a7-c6a3e48f682e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:03.094415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7df772-8317-4e2d-b9a7-c6a3e48f682e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:03.095051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7df772-8317-4e2d-b9a7-c6a3e48f682e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:03.150206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4e7df772-8317-4e2d-b9a7-c6a3e48f682e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:03.154129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4e7df772-8317-4e2d-b9a7-c6a3e48f682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:03.192328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:03.361905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 869/1723] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:03.371136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6302cf-2f33-4c6e-bfc9-0415322d9daf None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:03.371773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6302cf-2f33-4c6e-bfc9-0415322d9daf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:03.373146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6302cf-2f33-4c6e-bfc9-0415322d9daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:03.441951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8a6302cf-2f33-4c6e-bfc9-0415322d9daf None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:03.442420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7df772-8317-4e2d-b9a7-c6a3e48f682e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:03.443676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8a6302cf-2f33-4c6e-bfc9-0415322d9daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:03.444644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4e7df772-8317-4e2d-b9a7-c6a3e48f682e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:03.473460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7df772-8317-4e2d-b9a7-c6a3e48f682e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:03.478694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 855/1724] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:03.492112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6302cf-2f33-4c6e-bfc9-0415322d9daf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:03.500414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:03.502721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:03.503278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:03.503685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] PATH_INFO: `/v3/projects/c568c3f685264d9f95448c09486c3400` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:03.506430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c568c3f685264d9f95448c09486c3400)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:03.512957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6302cf-2f33-4c6e-bfc9-0415322d9daf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:03.515878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:03.547567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:03.548451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:03.548825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:03.549192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:03.550670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:03.551427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:03.553251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:03.600553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 856/1725] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:03.607710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:03.632554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ef747-98c1-4f0f-bd3f-f29ef14a7561 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:03.643849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceedfeb-da99-4dd7-9827-d815d8cd6caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:03.647056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceedfeb-da99-4dd7-9827-d815d8cd6caa admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:03.647556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceedfeb-da99-4dd7-9827-d815d8cd6caa admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:03.648317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceedfeb-da99-4dd7-9827-d815d8cd6caa admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:03.649288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceedfeb-da99-4dd7-9827-d815d8cd6caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:03.651817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceedfeb-da99-4dd7-9827-d815d8cd6caa admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:03.754959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c568c3f685264d9f95448c09486c3400', 'request_id': 'req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.762021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 857/1726] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:03 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:03.762893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceedfeb-da99-4dd7-9827-d815d8cd6caa admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:03.786157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c568c3f685264d9f95448c09486c3400', 'request_id': 'req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.805932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c568c3f685264d9f95448c09486c3400', 'request_id': 'req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.876989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] The token cache is being invalidate because project c568c3f685264d9f95448c09486c3400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:03.877452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.892188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:03.904109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 870/1727] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:03 2022] DELETE /identity/v3/projects/c568c3f685264d9f95448c09486c3400 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:03.914427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:03.916549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:04.023144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:04.086662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceedfeb-da99-4dd7-9827-d815d8cd6caa admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:04.092781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9bcd0-61bb-42c0-9e22-64fa362b2b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:04.093401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bcd0-61bb-42c0-9e22-64fa362b2b47 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:04.093686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bcd0-61bb-42c0-9e22-64fa362b2b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:04.094021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9bcd0-61bb-42c0-9e22-64fa362b2b47 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:04.094677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9bcd0-61bb-42c0-9e22-64fa362b2b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:04.100841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9bcd0-61bb-42c0-9e22-64fa362b2b47 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:04.142580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 858/1728] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:03 2022] POST /identity/v3/users => generated 303 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:04.146287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be04a-f0a1-4ecd-a5f7-6daa4013d4e2 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:04.146583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be04a-f0a1-4ecd-a5f7-6daa4013d4e2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:04.146861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be04a-f0a1-4ecd-a5f7-6daa4013d4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:04.154211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e8034-9eb8-4d0a-a0ca-861054c1eccd admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:04.160638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:04.170056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:04.170520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:04.170904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] PATH_INFO: `/v3/users/6fd65215187a40e7adefe52b68d6d3f4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:04.173093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fd65215187a40e7adefe52b68d6d3f4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:04.175480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:04.250539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e29be04a-f0a1-4ecd-a5f7-6daa4013d4e2 None None] MFA Rules not processed for user `d5f210085ee04473b2808f0a2dfc37ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:04.252277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e29be04a-f0a1-4ecd-a5f7-6daa4013d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:04.327469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:04.363365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fd65215187a40e7adefe52b68d6d3f4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:04.366220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fd65215187a40e7adefe52b68d6d3f4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:04.395047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fd65215187a40e7adefe52b68d6d3f4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:04.454906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fd65215187a40e7adefe52b68d6d3f4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:04.485907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fd65215187a40e7adefe52b68d6d3f4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:04.509283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 871/1729] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:03 2022] DELETE /identity/v3/users/6fd65215187a40e7adefe52b68d6d3f4 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:04.511629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:04.518758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:04.590089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 859/1730] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:04.591922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29be04a-f0a1-4ecd-a5f7-6daa4013d4e2 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:04.596113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e29be04a-f0a1-4ecd-a5f7-6daa4013d4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:04.647725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29be04a-f0a1-4ecd-a5f7-6daa4013d4e2 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:04.763862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d8e9b-ef26-46ed-a19c-e93ad947e4a8 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:04.772562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:04.773482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:04.773941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:04.774463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] PATH_INFO: `/v3/projects/a99d7cea19ee4e3eb1d0d1a321c5086e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:04.777434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99d7cea19ee4e3eb1d0d1a321c5086e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:04.781293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:04.854943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:04.855612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:04.855890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:04.856262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:04.857416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:04.865538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:04.904781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 860/1731] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:04.905951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:04.911457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:05.066939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99d7cea19ee4e3eb1d0d1a321c5086e', 'request_id': 'req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:05.097996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99d7cea19ee4e3eb1d0d1a321c5086e', 'request_id': 'req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:05.117364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99d7cea19ee4e3eb1d0d1a321c5086e', 'request_id': 'req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:05.157894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] The token cache is being invalidate because project a99d7cea19ee4e3eb1d0d1a321c5086e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:05.158419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:05.164452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8fc958c-a667-47ad-9e59-f5dfd1d27fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:05.182165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 872/1732] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:04 2022] DELETE /identity/v3/projects/a99d7cea19ee4e3eb1d0d1a321c5086e => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:05.183794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da206-d227-4541-9463-4cd592fa6074 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:05.186290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da206-d227-4541-9463-4cd592fa6074 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:05.186651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da206-d227-4541-9463-4cd592fa6074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:05.233487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf161d91-5069-449c-9fce-9dab0a3ec6b8 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:05.255929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:05.288782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-621da206-d227-4541-9463-4cd592fa6074 None None] MFA Rules not processed for user `886e718c9d7d48aa8655b8993e2af945`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:05.298203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-621da206-d227-4541-9463-4cd592fa6074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:05.455584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:05.491934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:05.492889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:05.493441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:05.493870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:05.496969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:05.510359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 873/1733] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Aug 31 09:46:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:05.517818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f906a-f479-49ed-a4f2-aabb762a4dab None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:05.518339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f906a-f479-49ed-a4f2-aabb762a4dab None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:05.520371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f906a-f479-49ed-a4f2-aabb762a4dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:05.572568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-252f906a-f479-49ed-a4f2-aabb762a4dab None None] MFA Rules not processed for user `2f4f149b17ac48c4931338cc7b0b2112`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:05.579518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-252f906a-f479-49ed-a4f2-aabb762a4dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:05.657843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:05.663514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:05.701181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 861/1734] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:05.704074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:05.708818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:05.849044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 874/1735] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:05.850012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f906a-f479-49ed-a4f2-aabb762a4dab None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:05.862787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-252f906a-f479-49ed-a4f2-aabb762a4dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:05.937572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc4fe-6f1a-4069-943e-381bf83078ed service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:05.949204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:05.951559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:05.952507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:05.954087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:05.956444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:05.964363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:06.006770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 862/1736] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:06.010891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:06.021757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:06.083017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81d45c-e570-4a25-8b7d-3f4959a31b7e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:06.107151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:06.108047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:06.108411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:06.108720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] PATH_INFO: `/v3/users/dce5fca421e0499dad3adccce4390ae9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:06.110990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dce5fca421e0499dad3adccce4390ae9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:06.121681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:06.128415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f906a-f479-49ed-a4f2-aabb762a4dab None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:06.160948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:06.163253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:06.163543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:06.163826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] PATH_INFO: `/v3/projects/60dcf51abce1472b822ff986e334368d` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:06.167661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60dcf51abce1472b822ff986e334368d)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:06.170150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:06.286318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:06.331684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dce5fca421e0499dad3adccce4390ae9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.346244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60dcf51abce1472b822ff986e334368d', 'request_id': 'req-4ded7c25-c354-4e74-8209-46bba04fcdb7'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.363011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60dcf51abce1472b822ff986e334368d', 'request_id': 'req-4ded7c25-c354-4e74-8209-46bba04fcdb7'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.375062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60dcf51abce1472b822ff986e334368d', 'request_id': 'req-4ded7c25-c354-4e74-8209-46bba04fcdb7'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.390813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] The token cache is being invalidate because project 60dcf51abce1472b822ff986e334368d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:06.391039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.391740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.393344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 875/1737] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:05 2022] DELETE /identity/v3/projects/60dcf51abce1472b822ff986e334368d => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:06.394127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:06.399346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:06.402438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dce5fca421e0499dad3adccce4390ae9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.404223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dce5fca421e0499dad3adccce4390ae9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.405202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dce5fca421e0499dad3adccce4390ae9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.423893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dce5fca421e0499dad3adccce4390ae9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.468949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 863/1738] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:06 2022] DELETE /identity/v3/users/dce5fca421e0499dad3adccce4390ae9 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:06.471917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:06.475110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:06.504965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:06.588896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded7c25-c354-4e74-8209-46bba04fcdb7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:06.761674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf597fc-c7ef-4ff8-9d6d-2d1fa4806309 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:06.772281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:06.773077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:06.773367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:06.773645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] PATH_INFO: `/v3/projects/fd43f6bd8823456c90c15b6343eb7aa2` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:06.777972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd43f6bd8823456c90c15b6343eb7aa2)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:06.786875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:06.800328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:06.806747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:06.807369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:06.808506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:06.826250 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:06.855206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:06.857293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:06.876629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 876/1739] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:06.877637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:06.879217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:06.919661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b29be5-28e9-4a51-a10e-38a7919361ae service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:06.974676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd43f6bd8823456c90c15b6343eb7aa2', 'request_id': 'req-54f9c114-5422-470e-a102-278d898a0a47'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:06.993646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd43f6bd8823456c90c15b6343eb7aa2', 'request_id': 'req-54f9c114-5422-470e-a102-278d898a0a47'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.012070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd43f6bd8823456c90c15b6343eb7aa2', 'request_id': 'req-54f9c114-5422-470e-a102-278d898a0a47'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.059129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] The token cache is being invalidate because project fd43f6bd8823456c90c15b6343eb7aa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:07.060902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.064333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.068309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 864/1740] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:06 2022] DELETE /identity/v3/projects/fd43f6bd8823456c90c15b6343eb7aa2 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:07.069596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:07.077654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:07.248135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:07.285839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851339a3-6ee6-4dd9-8531-a47560803717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:07.286541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851339a3-6ee6-4dd9-8531-a47560803717 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:07.286881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851339a3-6ee6-4dd9-8531-a47560803717 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:07.286995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851339a3-6ee6-4dd9-8531-a47560803717 admin admin] PATH_INFO: `/v3/projects/1e297e57c85240d9bb0004e4523df740/users/c21595c4396f46e790b223ada533fda1/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:07.328898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9c114-5422-470e-a102-278d898a0a47 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:07.334751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851339a3-6ee6-4dd9-8531-a47560803717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e297e57c85240d9bb0004e4523df740, user_id=c21595c4396f46e790b223ada533fda1, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:07.345006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851339a3-6ee6-4dd9-8531-a47560803717 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:07.369889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:07.370891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:07.371265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:07.371707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] PATH_INFO: `/v3/users/f1fb19b957574f4b80736fce35ab26bb` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:07.382239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1fb19b957574f4b80736fce35ab26bb)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:07.396565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 877/1741] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:06 2022] PUT /identity/v3/projects/1e297e57c85240d9bb0004e4523df740/users/c21595c4396f46e790b223ada533fda1/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:07.398943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ccc5f-ec92-4a13-9692-67c43d0bb6cf None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:07.399445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ccc5f-ec92-4a13-9692-67c43d0bb6cf None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:07.400038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11ccc5f-ec92-4a13-9692-67c43d0bb6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:07.416428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:07.473626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c11ccc5f-ec92-4a13-9692-67c43d0bb6cf None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:07.475400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c11ccc5f-ec92-4a13-9692-67c43d0bb6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:07.614069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1fb19b957574f4b80736fce35ab26bb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.653794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 878/1742] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:07.657153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f2b07-ae4a-446e-aaa5-e976b71fb64a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:07.657449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f2b07-ae4a-446e-aaa5-e976b71fb64a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:07.657733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f2b07-ae4a-446e-aaa5-e976b71fb64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:07.681091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1fb19b957574f4b80736fce35ab26bb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.682333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1fb19b957574f4b80736fce35ab26bb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.683588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1fb19b957574f4b80736fce35ab26bb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.709110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7764eaa7-4be7-4896-a199-28cf6685024d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1fb19b957574f4b80736fce35ab26bb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:07.727248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-156f2b07-ae4a-446e-aaa5-e976b71fb64a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:07.728535 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-156f2b07-ae4a-446e-aaa5-e976b71fb64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:07.751421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 865/1743] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:07 2022] DELETE /identity/v3/users/f1fb19b957574f4b80736fce35ab26bb => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:07.754431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 879/1744] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:07.755779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babb458-30be-4599-9889-4640d57ed65f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:07.756072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babb458-30be-4599-9889-4640d57ed65f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:07.756377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7babb458-30be-4599-9889-4640d57ed65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:07.813957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7babb458-30be-4599-9889-4640d57ed65f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:07.815345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7babb458-30be-4599-9889-4640d57ed65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:07.889512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f2b07-ae4a-446e-aaa5-e976b71fb64a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:07.892944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-156f2b07-ae4a-446e-aaa5-e976b71fb64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:07.900243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:07.989733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 866/1745] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:07.995985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babb458-30be-4599-9889-4640d57ed65f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:08.024547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f2b07-ae4a-446e-aaa5-e976b71fb64a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:08.030750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7babb458-30be-4599-9889-4640d57ed65f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:08.043425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cdf27-236c-4d7a-89ec-92d531d029bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:08.045123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cdf27-236c-4d7a-89ec-92d531d029bf admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.045473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cdf27-236c-4d7a-89ec-92d531d029bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.045833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cdf27-236c-4d7a-89ec-92d531d029bf admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.046516 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cdf27-236c-4d7a-89ec-92d531d029bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:08.047081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cdf27-236c-4d7a-89ec-92d531d029bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:08.048736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cdf27-236c-4d7a-89ec-92d531d029bf admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:08.079773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 867/1746] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:08.081134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730a8b4-a61c-401a-9118-2c56204fe956 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.081423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730a8b4-a61c-401a-9118-2c56204fe956 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.081702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730a8b4-a61c-401a-9118-2c56204fe956 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.083061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 868/1747] 10.222.0.18 () {54 vars in 912 bytes} [Wed Aug 31 09:46:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:46:08.094210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730a8b4-a61c-401a-9118-2c56204fe956 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:08.126936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730a8b4-a61c-401a-9118-2c56204fe956 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:08.141125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb257e-3da3-4593-ae80-1331d108bc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:08.141752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb257e-3da3-4593-ae80-1331d108bc80 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.142036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb257e-3da3-4593-ae80-1331d108bc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.142313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb257e-3da3-4593-ae80-1331d108bc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.143318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb257e-3da3-4593-ae80-1331d108bc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:08.144998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb257e-3da3-4593-ae80-1331d108bc80 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:08.165511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e388a-cd80-42c2-9aa4-3b58f81ea5c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:08.166489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e388a-cd80-42c2-9aa4-3b58f81ea5c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.166910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e388a-cd80-42c2-9aa4-3b58f81ea5c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.167269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e388a-cd80-42c2-9aa4-3b58f81ea5c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.192383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e388a-cd80-42c2-9aa4-3b58f81ea5c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:08.194826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e388a-cd80-42c2-9aa4-3b58f81ea5c8 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:08.219661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 869/1748] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:08 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:08.219661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed06bd-c827-4858-a705-532070e14e4f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.219661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed06bd-c827-4858-a705-532070e14e4f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.219661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed06bd-c827-4858-a705-532070e14e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.241205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 880/1749] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:08.242113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e388a-cd80-42c2-9aa4-3b58f81ea5c8 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:08.263605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e388a-cd80-42c2-9aa4-3b58f81ea5c8 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:08.269920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-51ed06bd-c827-4858-a705-532070e14e4f None None] MFA Rules not processed for user `886e718c9d7d48aa8655b8993e2af945`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:08.279281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-51ed06bd-c827-4858-a705-532070e14e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:08.332772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:08.459442 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 870/1750] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:46:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:08.472023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145de9-3ce4-401a-b1dc-aa8f0b80dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:08.472767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145de9-3ce4-401a-b1dc-aa8f0b80dfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.473188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145de9-3ce4-401a-b1dc-aa8f0b80dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.473520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145de9-3ce4-401a-b1dc-aa8f0b80dfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.474176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f145de9-3ce4-401a-b1dc-aa8f0b80dfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:08.478335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed06bd-c827-4858-a705-532070e14e4f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:08.479804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f145de9-3ce4-401a-b1dc-aa8f0b80dfb3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:08.484255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-51ed06bd-c827-4858-a705-532070e14e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:08.530451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed06bd-c827-4858-a705-532070e14e4f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:08.548007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 881/1751] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:08 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:08.552255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145de9-3ce4-401a-b1dc-aa8f0b80dfb3 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:08.561045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:08.561967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.562397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.562807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] PATH_INFO: `/v3/projects/a53c6130d2954f5bbd5a20375fe3a7ea` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.565699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53c6130d2954f5bbd5a20375fe3a7ea)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:08.573016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:08.598321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145de9-3ce4-401a-b1dc-aa8f0b80dfb3 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:08.623039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27543cca-e687-4f3f-b53a-44acd32579a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:08.623679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543cca-e687-4f3f-b53a-44acd32579a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.623965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543cca-e687-4f3f-b53a-44acd32579a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.624275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27543cca-e687-4f3f-b53a-44acd32579a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.632409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27543cca-e687-4f3f-b53a-44acd32579a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:08.634341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27543cca-e687-4f3f-b53a-44acd32579a2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:08.683333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 882/1752] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:08.684066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27543cca-e687-4f3f-b53a-44acd32579a2 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:08.747903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27543cca-e687-4f3f-b53a-44acd32579a2 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:08.803017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53c6130d2954f5bbd5a20375fe3a7ea', 'request_id': 'req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:08.826158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53c6130d2954f5bbd5a20375fe3a7ea', 'request_id': 'req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:08.860072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53c6130d2954f5bbd5a20375fe3a7ea', 'request_id': 'req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:08.902210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] The token cache is being invalidate because project a53c6130d2954f5bbd5a20375fe3a7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:08.902823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:08.906887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:08.910224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 871/1753] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:08 2022] DELETE /identity/v3/projects/a53c6130d2954f5bbd5a20375fe3a7ea => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:08.912499 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:08.916984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:08.921076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:08.953638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2aae0-db6f-491b-9d36-b36e97743a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:08.955731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aae0-db6f-491b-9d36-b36e97743a31 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:08.956123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aae0-db6f-491b-9d36-b36e97743a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:08.956826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2aae0-db6f-491b-9d36-b36e97743a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:08.966911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-53e2aae0-db6f-491b-9d36-b36e97743a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:08.990746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2aae0-db6f-491b-9d36-b36e97743a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:08.992410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e2aae0-db6f-491b-9d36-b36e97743a31 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.010455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 883/1754] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:09.014215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636684-20d6-43a6-b165-24f97c4d1efe None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.014957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636684-20d6-43a6-b165-24f97c4d1efe None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.015530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85636684-20d6-43a6-b165-24f97c4d1efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.073487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-85636684-20d6-43a6-b165-24f97c4d1efe None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:09.081133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-85636684-20d6-43a6-b165-24f97c4d1efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:09.099906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 884/1755] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:09.100471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd62630-3d4c-427b-8bc1-29c8e83b50b8 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:09.112391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7f2d-d4e3-42a0-810a-ce1997726f7a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.114381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7f2d-d4e3-42a0-810a-ce1997726f7a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.114689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea7f2d-d4e3-42a0-810a-ce1997726f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.130258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd3c66-ffb7-4058-8148-b7c75d418687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:09.132670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3c66-ffb7-4058-8148-b7c75d418687 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.132953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3c66-ffb7-4058-8148-b7c75d418687 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.133225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd3c66-ffb7-4058-8148-b7c75d418687 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.133904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd3c66-ffb7-4058-8148-b7c75d418687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:09.141443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd3c66-ffb7-4058-8148-b7c75d418687 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.190495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 872/1756] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:09.191646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd3c66-ffb7-4058-8148-b7c75d418687 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:09.220342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-47ea7f2d-d4e3-42a0-810a-ce1997726f7a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:09.225082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd3c66-ffb7-4058-8148-b7c75d418687 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:09.230359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-47ea7f2d-d4e3-42a0-810a-ce1997726f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:09.256211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e7f311-20ed-4caa-b14d-08ac0a12a51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:09.257837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 885/1757] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:09.262194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7f311-20ed-4caa-b14d-08ac0a12a51e admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.263039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea7f2d-d4e3-42a0-810a-ce1997726f7a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:09.263436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7f311-20ed-4caa-b14d-08ac0a12a51e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.263840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e7f311-20ed-4caa-b14d-08ac0a12a51e admin admin] PATH_INFO: `/v3/projects/968bcc3a3ca644168a41ebabdb76753b/users/b156233592684c2495a690503e9c2f09/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.286338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea7f2d-d4e3-42a0-810a-ce1997726f7a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:09.297983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:09.299297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.305656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.305946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.308899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:09.310912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:09.317882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.331337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7f311-20ed-4caa-b14d-08ac0a12a51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=968bcc3a3ca644168a41ebabdb76753b, user_id=b156233592684c2495a690503e9c2f09, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:09.334731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e7f311-20ed-4caa-b14d-08ac0a12a51e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.350170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 886/1758] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:09.355687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:09.379878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab658c88-1059-48a8-a83e-1badb751c3df admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:09.405784 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 873/1759] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:09 2022] PUT /identity/v3/projects/968bcc3a3ca644168a41ebabdb76753b/users/b156233592684c2495a690503e9c2f09/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:09.412325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dbd67-e11e-45bd-a95e-92b4af16910c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.412755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dbd67-e11e-45bd-a95e-92b4af16910c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.413272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dbd67-e11e-45bd-a95e-92b4af16910c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.472208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-da3dbd67-e11e-45bd-a95e-92b4af16910c None None] MFA Rules not processed for user `b156233592684c2495a690503e9c2f09`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:09.473690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-da3dbd67-e11e-45bd-a95e-92b4af16910c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:09.497247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:09.559875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6017af2-cbb7-4b58-a569-78080b159fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:09.565403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017af2-cbb7-4b58-a569-78080b159fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.565747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017af2-cbb7-4b58-a569-78080b159fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.566031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6017af2-cbb7-4b58-a569-78080b159fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.567516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6017af2-cbb7-4b58-a569-78080b159fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:09.575823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6017af2-cbb7-4b58-a569-78080b159fc7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.595821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 874/1760] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:09.601724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dbd67-e11e-45bd-a95e-92b4af16910c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:09.616793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dbd67-e11e-45bd-a95e-92b4af16910c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:09.625220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5f0c9-152e-4973-92c0-943cb5c44905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:09.626161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f0c9-152e-4973-92c0-943cb5c44905 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.626669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f0c9-152e-4973-92c0-943cb5c44905 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.627471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5f0c9-152e-4973-92c0-943cb5c44905 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.628473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5f0c9-152e-4973-92c0-943cb5c44905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:09.646764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c5f0c9-152e-4973-92c0-943cb5c44905 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.681064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 887/1761] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:09 2022] POST /identity/v3/projects => generated 387 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:09.691190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6017af2-cbb7-4b58-a569-78080b159fc7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:09.752705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 875/1762] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:09 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:09.766051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5f0c9-152e-4973-92c0-943cb5c44905 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:09.865062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5f0c9-152e-4973-92c0-943cb5c44905 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:09.877540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244719d-3b02-4c8a-889f-dd8a63d8d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:09.878056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244719d-3b02-4c8a-889f-dd8a63d8d6a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.878339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244719d-3b02-4c8a-889f-dd8a63d8d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.878711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0244719d-3b02-4c8a-889f-dd8a63d8d6a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.880053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244719d-3b02-4c8a-889f-dd8a63d8d6a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:09.883936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0244719d-3b02-4c8a-889f-dd8a63d8d6a9 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.903186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6017af2-cbb7-4b58-a569-78080b159fc7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:09.920049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15090e2e-8736-4e53-8d41-7284ba7e0147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:09.921473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090e2e-8736-4e53-8d41-7284ba7e0147 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.922167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090e2e-8736-4e53-8d41-7284ba7e0147 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.922677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15090e2e-8736-4e53-8d41-7284ba7e0147 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.923492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15090e2e-8736-4e53-8d41-7284ba7e0147 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:09.931554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15090e2e-8736-4e53-8d41-7284ba7e0147 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.938221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 876/1763] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:09 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:09.939337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244719d-3b02-4c8a-889f-dd8a63d8d6a9 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:09.962064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0244719d-3b02-4c8a-889f-dd8a63d8d6a9 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:09.978071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1511de-d213-4252-bf6f-66fb8de62d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:09.983063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1511de-d213-4252-bf6f-66fb8de62d39 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.983813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 888/1764] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:09 2022] POST /identity/v3/users => generated 294 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:09.985441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1511de-d213-4252-bf6f-66fb8de62d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.985684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1511de-d213-4252-bf6f-66fb8de62d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.986380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1511de-d213-4252-bf6f-66fb8de62d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:09.986666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23eb8-ddff-49a9-a397-5458088d557e None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:09.986957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23eb8-ddff-49a9-a397-5458088d557e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:09.987238 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf23eb8-ddff-49a9-a397-5458088d557e None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:09.989899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1511de-d213-4252-bf6f-66fb8de62d39 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:09.991915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 889/1765] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:46:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:46:09.993123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23eb8-ddff-49a9-a397-5458088d557e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:10.034813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 877/1766] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:10.038484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1511de-d213-4252-bf6f-66fb8de62d39 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:10.052665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf23eb8-ddff-49a9-a397-5458088d557e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:10.058360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bab4d3-aff6-4d9c-bd8e-25a4988fd8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:10.058993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bab4d3-aff6-4d9c-bd8e-25a4988fd8fc admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:10.059820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bab4d3-aff6-4d9c-bd8e-25a4988fd8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:10.060099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bab4d3-aff6-4d9c-bd8e-25a4988fd8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:10.063036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1511de-d213-4252-bf6f-66fb8de62d39 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:10.063995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bab4d3-aff6-4d9c-bd8e-25a4988fd8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:10.066306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bab4d3-aff6-4d9c-bd8e-25a4988fd8fc admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:10.076705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fbd42-4646-44ff-b675-f3a18cc126ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:10.077460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fbd42-4646-44ff-b675-f3a18cc126ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:10.077751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fbd42-4646-44ff-b675-f3a18cc126ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:10.078187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fbd42-4646-44ff-b675-f3a18cc126ed admin admin] PATH_INFO: `/v3/projects/2be6958a17b346949aacba395163f202/users/3c80410b72ad4259be7a4959ebf31c87/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:10.096144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 890/1767] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:10.097739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8263-54b0-4247-b233-d8799ff05317 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:10.098175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8263-54b0-4247-b233-d8799ff05317 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:10.098307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8263-54b0-4247-b233-d8799ff05317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:10.114856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fbd42-4646-44ff-b675-f3a18cc126ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be6958a17b346949aacba395163f202, user_id=3c80410b72ad4259be7a4959ebf31c87, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:10.120257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582fbd42-4646-44ff-b675-f3a18cc126ed admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:10.153145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ee0d8263-54b0-4247-b233-d8799ff05317 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:10.158650 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 878/1768] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:10 2022] PUT /identity/v3/projects/2be6958a17b346949aacba395163f202/users/3c80410b72ad4259be7a4959ebf31c87/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:10.159852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ee0d8263-54b0-4247-b233-d8799ff05317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:10.162159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fbd42-4646-44ff-b675-f3a18cc126ed admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:10.212054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:10.305818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:10.332772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582fbd42-4646-44ff-b675-f3a18cc126ed admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:10.354361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 891/1769] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:46:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:10.355536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8263-54b0-4247-b233-d8799ff05317 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:10.358360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d570638-9ea8-4559-b868-56cd85de3097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:10.358996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570638-9ea8-4559-b868-56cd85de3097 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:10.359271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570638-9ea8-4559-b868-56cd85de3097 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:10.359550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d570638-9ea8-4559-b868-56cd85de3097 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:10.360207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570638-9ea8-4559-b868-56cd85de3097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:10.361840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d570638-9ea8-4559-b868-56cd85de3097 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:10.399195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 879/1770] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:10.400913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d8263-54b0-4247-b233-d8799ff05317 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:10.401051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d570638-9ea8-4559-b868-56cd85de3097 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:10.414868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dba4e5-c2d7-4c32-965c-e6d860f85d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:10.415576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba4e5-c2d7-4c32-965c-e6d860f85d70 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:10.417220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba4e5-c2d7-4c32-965c-e6d860f85d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:10.418057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba4e5-c2d7-4c32-965c-e6d860f85d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:10.423209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dba4e5-c2d7-4c32-965c-e6d860f85d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:10.424995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dba4e5-c2d7-4c32-965c-e6d860f85d70 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:10.436425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d570638-9ea8-4559-b868-56cd85de3097 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:10.458048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228aa44-1237-48f0-a767-03b511d6446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:10.458735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228aa44-1237-48f0-a767-03b511d6446c admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:10.459015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228aa44-1237-48f0-a767-03b511d6446c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:10.459290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228aa44-1237-48f0-a767-03b511d6446c admin admin] PATH_INFO: `/v3/projects/315de11ff2644f1594032c20a08879bf/users/d6cc877e5c294ec490dcad3b8b860184/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:10.479568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 892/1771] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:10.480572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dba4e5-c2d7-4c32-965c-e6d860f85d70 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:10.526600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dba4e5-c2d7-4c32-965c-e6d860f85d70 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:10.529851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228aa44-1237-48f0-a767-03b511d6446c admin admin] RBAC: Authorizing `identity:create_grant(project_id=315de11ff2644f1594032c20a08879bf, user_id=d6cc877e5c294ec490dcad3b8b860184, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:10.533289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228aa44-1237-48f0-a767-03b511d6446c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:10.558458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:10.559060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:10.559949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:10.560613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] PATH_INFO: `/v3/projects/2be6958a17b346949aacba395163f202/users/3c80410b72ad4259be7a4959ebf31c87/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:10.570162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2be6958a17b346949aacba395163f202, user_id=3c80410b72ad4259be7a4959ebf31c87, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:10.573050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:10.607355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 880/1772] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:10 2022] PUT /identity/v3/projects/315de11ff2644f1594032c20a08879bf/users/d6cc877e5c294ec490dcad3b8b860184/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:10.618732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800123b-f678-4b61-b627-b4bd57bb7cd7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:10.619100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800123b-f678-4b61-b627-b4bd57bb7cd7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:10.619335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800123b-f678-4b61-b627-b4bd57bb7cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:10.658456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 893/1773] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:10 2022] PUT /identity/v3/projects/2be6958a17b346949aacba395163f202/users/3c80410b72ad4259be7a4959ebf31c87/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:10.659639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:10.673945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:10.754226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0800123b-f678-4b61-b627-b4bd57bb7cd7 None None] MFA Rules not processed for user `d6cc877e5c294ec490dcad3b8b860184`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:10.755596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0800123b-f678-4b61-b627-b4bd57bb7cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:10.997045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496b5c3-ef0a-4dda-a95b-3d0902f01471 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:11.032110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:11.032801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:11.033083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:11.033355 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] PATH_INFO: `/v3/projects/ce4c28e5a4af4abaa0aa8b893f2509bf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:11.039685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4c28e5a4af4abaa0aa8b893f2509bf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:11.041803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:11.102483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 881/1774] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:11.103887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5fc8d-92ac-42c6-96b2-8363e2f4b4dd None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:11.104205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5fc8d-92ac-42c6-96b2-8363e2f4b4dd None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:11.104473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5fc8d-92ac-42c6-96b2-8363e2f4b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:11.270400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5cb5fc8d-92ac-42c6-96b2-8363e2f4b4dd None None] MFA Rules not processed for user `3c80410b72ad4259be7a4959ebf31c87`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:11.271908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5cb5fc8d-92ac-42c6-96b2-8363e2f4b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:11.298545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4c28e5a4af4abaa0aa8b893f2509bf', 'request_id': 'req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:11.326261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4c28e5a4af4abaa0aa8b893f2509bf', 'request_id': 'req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:11.354161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4c28e5a4af4abaa0aa8b893f2509bf', 'request_id': 'req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:11.407035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] The token cache is being invalidate because project ce4c28e5a4af4abaa0aa8b893f2509bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:11.407337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:11.408664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:11.415254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 894/1775] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:10 2022] DELETE /identity/v3/projects/ce4c28e5a4af4abaa0aa8b893f2509bf => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:11.415254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:11.417706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:11.521082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:11.588696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 882/1776] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:11 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 486 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:11.589668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5fc8d-92ac-42c6-96b2-8363e2f4b4dd None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:11.594288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5cb5fc8d-92ac-42c6-96b2-8363e2f4b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:11.694718 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e1ecd-7e1c-498b-ba4d-1b7710f6e060 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:11.712319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd6cc1-8f90-4cd6-a8fc-cdeed0a4817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:11.712966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6cc1-8f90-4cd6-a8fc-cdeed0a4817b admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:11.713248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6cc1-8f90-4cd6-a8fc-cdeed0a4817b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:11.713522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd6cc1-8f90-4cd6-a8fc-cdeed0a4817b admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:11.714240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6cc1-8f90-4cd6-a8fc-cdeed0a4817b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:11.721674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd6cc1-8f90-4cd6-a8fc-cdeed0a4817b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:11.744701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:11.837930 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 895/1777] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:11 2022] POST /identity/v3/projects => generated 387 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:11.839172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a739-d039-4a98-9f6f-f56ed98e8f2c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:11.839455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a739-d039-4a98-9f6f-f56ed98e8f2c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:11.839728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a739-d039-4a98-9f6f-f56ed98e8f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:11.863072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5fc8d-92ac-42c6-96b2-8363e2f4b4dd None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:11.900368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8a95a739-d039-4a98-9f6f-f56ed98e8f2c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:11.912669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8a95a739-d039-4a98-9f6f-f56ed98e8f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:12.051208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:12.051839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:12.052116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:12.052410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:12.055284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:12.079647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:12.081342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:12.105444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 883/1778] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:12.106454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:12.121361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:12.219826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 896/1779] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:12.234787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a739-d039-4a98-9f6f-f56ed98e8f2c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:12.286811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a739-d039-4a98-9f6f-f56ed98e8f2c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:12.314652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e39e-0572-4dc1-9f31-7f4b21681646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:12.317228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e39e-0572-4dc1-9f31-7f4b21681646 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:12.317578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e39e-0572-4dc1-9f31-7f4b21681646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:12.317865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e39e-0572-4dc1-9f31-7f4b21681646 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:12.318593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0e39e-0572-4dc1-9f31-7f4b21681646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:12.334149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0e39e-0572-4dc1-9f31-7f4b21681646 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:12.397970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccb5aa-21c5-40cf-8248-898b7891c995 service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:12.410411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c908a1-077d-43f0-86d8-b3083470cd4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:12.414553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c908a1-077d-43f0-86d8-b3083470cd4f service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:12.414968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c908a1-077d-43f0-86d8-b3083470cd4f service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:12.415295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c908a1-077d-43f0-86d8-b3083470cd4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:12.480406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 897/1780] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:12 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:12.491547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f58189-7b2e-46da-ba8f-af70967f84dd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:12.491865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f58189-7b2e-46da-ba8f-af70967f84dd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:12.492127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f58189-7b2e-46da-ba8f-af70967f84dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:12.608335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e9f58189-7b2e-46da-ba8f-af70967f84dd None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:12.609337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e9f58189-7b2e-46da-ba8f-af70967f84dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:12.651565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c908a1-077d-43f0-86d8-b3083470cd4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:12.652633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 898/1781] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:12.656292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f58189-7b2e-46da-ba8f-af70967f84dd None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:12.662723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c908a1-077d-43f0-86d8-b3083470cd4f service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:12.700817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f58189-7b2e-46da-ba8f-af70967f84dd None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:12.716580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c077438-2386-441f-a4da-6e1f6ff006a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:12.717348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c077438-2386-441f-a4da-6e1f6ff006a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:12.717620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c077438-2386-441f-a4da-6e1f6ff006a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:12.717906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c077438-2386-441f-a4da-6e1f6ff006a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:12.718589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c077438-2386-441f-a4da-6e1f6ff006a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:12.728034 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 884/1782] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:12 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:12.729523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c908a1-077d-43f0-86d8-b3083470cd4f service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:12.746425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c077438-2386-441f-a4da-6e1f6ff006a5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:12.783478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 899/1783] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:12.790657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c077438-2386-441f-a4da-6e1f6ff006a5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:12.812049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c908a1-077d-43f0-86d8-b3083470cd4f service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:12.832275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c077438-2386-441f-a4da-6e1f6ff006a5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:12.842051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:12.842681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:12.842965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:12.843230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:12.853121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:12.853436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:12.855067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:12.856125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12952-cf12-4ce9-bd2c-567ca917bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:12.856935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12952-cf12-4ce9-bd2c-567ca917bef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:12.857236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12952-cf12-4ce9-bd2c-567ca917bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:12.857513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12952-cf12-4ce9-bd2c-567ca917bef5 admin admin] PATH_INFO: `/v3/projects/a1b9f67b68364d73b7908ae80a3e2b43/users/b95d92b4a9414256bb3269c74573d79b/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:12.895262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:12.900312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f12952-cf12-4ce9-bd2c-567ca917bef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b9f67b68364d73b7908ae80a3e2b43, user_id=b95d92b4a9414256bb3269c74573d79b, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:12.905350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 885/1784] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:12.909030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:12.915199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f12952-cf12-4ce9-bd2c-567ca917bef5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:12.928962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba89a34d-e46d-4179-b27b-a78511fdd28f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:12.949418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef67ab-4e59-46df-91d5-b53eebf9a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:12.951840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef67ab-4e59-46df-91d5-b53eebf9a30e admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:12.952246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef67ab-4e59-46df-91d5-b53eebf9a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:12.952617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef67ab-4e59-46df-91d5-b53eebf9a30e admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:12.953367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef67ab-4e59-46df-91d5-b53eebf9a30e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:12.958651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef67ab-4e59-46df-91d5-b53eebf9a30e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:13.007758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 900/1785] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:12 2022] PUT /identity/v3/projects/a1b9f67b68364d73b7908ae80a3e2b43/users/b95d92b4a9414256bb3269c74573d79b/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:13.007915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12952-cf12-4ce9-bd2c-567ca917bef5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:13.026402 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 886/1786] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:12 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:13.027589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef67ab-4e59-46df-91d5-b53eebf9a30e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:13.158158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:13.163898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12952-cf12-4ce9-bd2c-567ca917bef5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:13.221130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef67ab-4e59-46df-91d5-b53eebf9a30e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:13.236875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba734c9-cff0-483e-8070-83ec3932bb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:13.239374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba734c9-cff0-483e-8070-83ec3932bb87 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:13.241649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba734c9-cff0-483e-8070-83ec3932bb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:13.242324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba734c9-cff0-483e-8070-83ec3932bb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:13.245811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba734c9-cff0-483e-8070-83ec3932bb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:13.251098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba734c9-cff0-483e-8070-83ec3932bb87 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:13.312847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 887/1787] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:13.314485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba734c9-cff0-483e-8070-83ec3932bb87 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:13.341017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43498e7-9ea9-45c8-a413-5d432ecb0bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:13.342797 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43498e7-9ea9-45c8-a413-5d432ecb0bba service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:13.344000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43498e7-9ea9-45c8-a413-5d432ecb0bba service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:13.345813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43498e7-9ea9-45c8-a413-5d432ecb0bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:13.350689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f43498e7-9ea9-45c8-a413-5d432ecb0bba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:13.359764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba734c9-cff0-483e-8070-83ec3932bb87 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:13.392659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c87b33-ba66-4af9-883a-d60fa0009ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:13.393489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87b33-ba66-4af9-883a-d60fa0009ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:13.395017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87b33-ba66-4af9-883a-d60fa0009ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:13.395361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87b33-ba66-4af9-883a-d60fa0009ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:13.400892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c87b33-ba66-4af9-883a-d60fa0009ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:13.404979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c87b33-ba66-4af9-883a-d60fa0009ef5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:13.447685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 888/1788] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:13 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:13.448586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c87b33-ba66-4af9-883a-d60fa0009ef5 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:13.476891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c87b33-ba66-4af9-883a-d60fa0009ef5 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:13.488471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884871e-b127-427e-84c6-8a530a3fc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:13.489155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884871e-b127-427e-84c6-8a530a3fc785 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:13.489448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884871e-b127-427e-84c6-8a530a3fc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:13.489721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884871e-b127-427e-84c6-8a530a3fc785 admin admin] PATH_INFO: `/v3/projects/a1b9f67b68364d73b7908ae80a3e2b43/users/b95d92b4a9414256bb3269c74573d79b/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:13.499025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884871e-b127-427e-84c6-8a530a3fc785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b9f67b68364d73b7908ae80a3e2b43, user_id=b95d92b4a9414256bb3269c74573d79b, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:13.501900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884871e-b127-427e-84c6-8a530a3fc785 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:13.553246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 889/1789] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:13 2022] PUT /identity/v3/projects/a1b9f67b68364d73b7908ae80a3e2b43/users/b95d92b4a9414256bb3269c74573d79b/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:13.559284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884871e-b127-427e-84c6-8a530a3fc785 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:13.586400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43498e7-9ea9-45c8-a413-5d432ecb0bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:13.587873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43498e7-9ea9-45c8-a413-5d432ecb0bba service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:13.650206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 901/1790] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:13.652507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf019-3af9-4d7c-8712-a5e7ff70dc3e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:13.658467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf019-3af9-4d7c-8712-a5e7ff70dc3e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:13.658801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becf019-3af9-4d7c-8712-a5e7ff70dc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:13.776766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884871e-b127-427e-84c6-8a530a3fc785 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:13.788389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0becf019-3af9-4d7c-8712-a5e7ff70dc3e None None] MFA Rules not processed for user `b95d92b4a9414256bb3269c74573d79b`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:13.789086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ff54-f6d4-436b-af05-c91290514bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:13.789886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ff54-f6d4-436b-af05-c91290514bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:13.790189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ff54-f6d4-436b-af05-c91290514bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:13.790608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857ff54-f6d4-436b-af05-c91290514bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:13.791197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857ff54-f6d4-436b-af05-c91290514bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:13.791791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0becf019-3af9-4d7c-8712-a5e7ff70dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:13.794758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e857ff54-f6d4-436b-af05-c91290514bf7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:13.824980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 890/1791] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:13.826408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ff54-f6d4-436b-af05-c91290514bf7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:13.847919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e857ff54-f6d4-436b-af05-c91290514bf7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:13.861452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2cf2b-fc8c-47dc-b30e-093ca2b941ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:13.862081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2cf2b-fc8c-47dc-b30e-093ca2b941ea admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:13.862366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2cf2b-fc8c-47dc-b30e-093ca2b941ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:13.862644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2cf2b-fc8c-47dc-b30e-093ca2b941ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:13.863373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2cf2b-fc8c-47dc-b30e-093ca2b941ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:13.865040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2cf2b-fc8c-47dc-b30e-093ca2b941ea admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:13.891060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 891/1792] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:13.893362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2cf2b-fc8c-47dc-b30e-093ca2b941ea admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:13.937450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2cf2b-fc8c-47dc-b30e-093ca2b941ea admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:13.949380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5fb834-72d1-4122-87be-2aade8ba6aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:13.951171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb834-72d1-4122-87be-2aade8ba6aa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:13.951464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb834-72d1-4122-87be-2aade8ba6aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:13.951738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5fb834-72d1-4122-87be-2aade8ba6aa1 admin admin] PATH_INFO: `/v3/projects/6fd1e267d61f4e90b227609ede41c23f/users/d8daceadb31a4cf99a76dd203bd07e08/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:13.990135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 902/1793] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:13 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:14.003861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fb834-72d1-4122-87be-2aade8ba6aa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd1e267d61f4e90b227609ede41c23f, user_id=d8daceadb31a4cf99a76dd203bd07e08, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:14.006604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5fb834-72d1-4122-87be-2aade8ba6aa1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:14.014887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becf019-3af9-4d7c-8712-a5e7ff70dc3e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:14.018015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0becf019-3af9-4d7c-8712-a5e7ff70dc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:14.061191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 892/1794] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:13 2022] PUT /identity/v3/projects/6fd1e267d61f4e90b227609ede41c23f/users/d8daceadb31a4cf99a76dd203bd07e08/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:14.075897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b9419-3678-4ede-b62b-162ba1883454 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:14.076298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b9419-3678-4ede-b62b-162ba1883454 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:14.076583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b9419-3678-4ede-b62b-162ba1883454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:14.106612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:14.157634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-1c5b9419-3678-4ede-b62b-162ba1883454 None None] MFA Rules not processed for user `d8daceadb31a4cf99a76dd203bd07e08`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:14.158863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1c5b9419-3678-4ede-b62b-162ba1883454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:14.193465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:14.227433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becf019-3af9-4d7c-8712-a5e7ff70dc3e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:14.349193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 893/1795] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:14.353549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b9419-3678-4ede-b62b-162ba1883454 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:14.390618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6fede-d774-4569-9462-8d77fedc3cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:14.391246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6fede-d774-4569-9462-8d77fedc3cdc service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:14.391529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6fede-d774-4569-9462-8d77fedc3cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:14.391792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6fede-d774-4569-9462-8d77fedc3cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:14.517769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b9419-3678-4ede-b62b-162ba1883454 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:14.548825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3295d-1455-491b-945d-a4fd8fffd76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:14.549528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3295d-1455-491b-945d-a4fd8fffd76d admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:14.549808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3295d-1455-491b-945d-a4fd8fffd76d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:14.550222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3295d-1455-491b-945d-a4fd8fffd76d admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:14.550735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3295d-1455-491b-945d-a4fd8fffd76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:14.552854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3295d-1455-491b-945d-a4fd8fffd76d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:14.569009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6fede-d774-4569-9462-8d77fedc3cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:14.570493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6fede-d774-4569-9462-8d77fedc3cdc service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:14.617853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 903/1796] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:14.659928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 894/1797] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:14 2022] POST /identity/v3/projects => generated 381 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:14.668363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6fede-d774-4569-9462-8d77fedc3cdc service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:14.688661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6fede-d774-4569-9462-8d77fedc3cdc service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:14.839871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3295d-1455-491b-945d-a4fd8fffd76d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:14.896816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de296fe3-6ff2-4382-b581-9689e8dbe29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:14.901597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296fe3-6ff2-4382-b581-9689e8dbe29f admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:14.901961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296fe3-6ff2-4382-b581-9689e8dbe29f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:14.902244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de296fe3-6ff2-4382-b581-9689e8dbe29f admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:14.903633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de296fe3-6ff2-4382-b581-9689e8dbe29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:14.914508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de296fe3-6ff2-4382-b581-9689e8dbe29f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:14.983759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 904/1798] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:14 2022] POST /identity/v3/users => generated 297 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:14.988548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de296fe3-6ff2-4382-b581-9689e8dbe29f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:15.025728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de296fe3-6ff2-4382-b581-9689e8dbe29f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:15.042663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac304-fd96-4500-b18c-46022ae8ffaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:15.044315 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac304-fd96-4500-b18c-46022ae8ffaf admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:15.045833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac304-fd96-4500-b18c-46022ae8ffaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:15.046125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cac304-fd96-4500-b18c-46022ae8ffaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:15.049481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cac304-fd96-4500-b18c-46022ae8ffaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:15.055123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cac304-fd96-4500-b18c-46022ae8ffaf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:15.099948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 905/1799] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:15.101339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac304-fd96-4500-b18c-46022ae8ffaf admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:15.134241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3295d-1455-491b-945d-a4fd8fffd76d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:15.141055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:15.142703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:15.143216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:15.143937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] PATH_INFO: `/v3/users/d6cc877e5c294ec490dcad3b8b860184` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:15.146489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6cc877e5c294ec490dcad3b8b860184)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:15.148947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cac304-fd96-4500-b18c-46022ae8ffaf admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:15.150867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:15.179882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:15.182132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:15.183620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:15.186078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:15.188213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] PATH_INFO: `/v3/projects/145181602fd14864a24c918bf0688650/users/bdc8efb77a8c4284ba788ce7e011fd21/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:15.232667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6cc877e5c294ec490dcad3b8b860184'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:15.245092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145181602fd14864a24c918bf0688650, user_id=bdc8efb77a8c4284ba788ce7e011fd21, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:15.248938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:15.249921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6cc877e5c294ec490dcad3b8b860184'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:15.250717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6cc877e5c294ec490dcad3b8b860184'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:15.252024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6cc877e5c294ec490dcad3b8b860184'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:15.267979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2091428a-536d-47d9-a70f-66d592da0218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6cc877e5c294ec490dcad3b8b860184'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:15.277784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 906/1800] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:15 2022] PUT /identity/v3/projects/145181602fd14864a24c918bf0688650/users/bdc8efb77a8c4284ba788ce7e011fd21/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:15.282863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:15.285610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:15.293724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:15.310140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 895/1801] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:14 2022] DELETE /identity/v3/users/d6cc877e5c294ec490dcad3b8b860184 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:15.312301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e3c74-cf44-42cb-adfd-d156791af3cb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:15.312574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e3c74-cf44-42cb-adfd-d156791af3cb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:15.312860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e3c74-cf44-42cb-adfd-d156791af3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:15.356882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-806e3c74-cf44-42cb-adfd-d156791af3cb None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:15.360038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-806e3c74-cf44-42cb-adfd-d156791af3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:15.455832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c54c2-9b47-4802-bc11-9cb4199cc000 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:15.493223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 896/1802] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:15.526086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e3c74-cf44-42cb-adfd-d156791af3cb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:15.527920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-806e3c74-cf44-42cb-adfd-d156791af3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:15.690708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcc80b-7b39-4a57-858c-5b68549b352a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:15.691401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc80b-7b39-4a57-858c-5b68549b352a admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:15.691686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc80b-7b39-4a57-858c-5b68549b352a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:15.692002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcc80b-7b39-4a57-858c-5b68549b352a admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:15.693350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcc80b-7b39-4a57-858c-5b68549b352a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:15.696940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcc80b-7b39-4a57-858c-5b68549b352a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:15.718572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 907/1803] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:15.719599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcc80b-7b39-4a57-858c-5b68549b352a admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:15.729961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e3c74-cf44-42cb-adfd-d156791af3cb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:15.737425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:15.737678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:15.737878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:15.738185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:15.741104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcc80b-7b39-4a57-858c-5b68549b352a admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:15.754803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd27d5-e9a9-410f-a82f-0bf239a081d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:15.756436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd27d5-e9a9-410f-a82f-0bf239a081d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:15.756947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd27d5-e9a9-410f-a82f-0bf239a081d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:15.759705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd27d5-e9a9-410f-a82f-0bf239a081d2 admin admin] PATH_INFO: `/v3/projects/145181602fd14864a24c918bf0688650/users/bdc8efb77a8c4284ba788ce7e011fd21/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:15.765523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:15.767776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd27d5-e9a9-410f-a82f-0bf239a081d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=145181602fd14864a24c918bf0688650, user_id=bdc8efb77a8c4284ba788ce7e011fd21, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:15.770682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd27d5-e9a9-410f-a82f-0bf239a081d2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:15.773072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:15.814018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 908/1804] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:15 2022] PUT /identity/v3/projects/145181602fd14864a24c918bf0688650/users/bdc8efb77a8c4284ba788ce7e011fd21/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:15.826186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 897/1805] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:15.827155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9c81-9dae-4d4c-9d95-84940e23bed0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:15.827616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9c81-9dae-4d4c-9d95-84940e23bed0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:15.828037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab9c81-9dae-4d4c-9d95-84940e23bed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:15.882864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4eab9c81-9dae-4d4c-9d95-84940e23bed0 None None] MFA Rules not processed for user `bdc8efb77a8c4284ba788ce7e011fd21`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:15.888599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4eab9c81-9dae-4d4c-9d95-84940e23bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:16.133472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 909/1806] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:16.143058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:16.144942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:16.245915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:16.261875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323dba08-d298-4937-8379-606c81fdcfc4 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:16.367961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:16.368987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:16.369810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:16.369810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:16.384361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:16.386319 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:16.415378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 898/1807] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:16 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:17.159674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc57fd-f0ca-4530-8ca9-c08ecabd0a10 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:17.160228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc57fd-f0ca-4530-8ca9-c08ecabd0a10 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:17.160353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc57fd-f0ca-4530-8ca9-c08ecabd0a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:17.334966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-defc57fd-f0ca-4530-8ca9-c08ecabd0a10 None None] MFA Rules not processed for user `c21595c4396f46e790b223ada533fda1`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:17.336941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-defc57fd-f0ca-4530-8ca9-c08ecabd0a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:17.348927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:17.477335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 910/1808] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:17 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:17.478750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:17.480375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:17.520613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc57fd-f0ca-4530-8ca9-c08ecabd0a10 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:17.561322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc57fd-f0ca-4530-8ca9-c08ecabd0a10 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:17.573089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdc8efb77a8c4284ba788ce7e011fd21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145181602fd14864a24c918bf0688650', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:17.576244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:17.576544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:17.577097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:17.580546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:17.580875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:17.584402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:17.627343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 911/1809] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:17.628329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:17.653880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ade82-a46e-45ea-a324-19e1ec43bd0d tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:17.671737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58261bf5-ba74-41e4-bfd4-b85c98ad7578 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdc8efb77a8c4284ba788ce7e011fd21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145181602fd14864a24c918bf0688650', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:17.672412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261bf5-ba74-41e4-bfd4-b85c98ad7578 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:17.672703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261bf5-ba74-41e4-bfd4-b85c98ad7578 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:17.677543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261bf5-ba74-41e4-bfd4-b85c98ad7578 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:17.680348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58261bf5-ba74-41e4-bfd4-b85c98ad7578 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:17.685637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd481-d606-4548-80b3-8a88dd19788f service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:17.690391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58261bf5-ba74-41e4-bfd4-b85c98ad7578 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:17.690965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfa585-a937-40c8-bef6-65ed20d12431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:17.691681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfa585-a937-40c8-bef6-65ed20d12431 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:17.692030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfa585-a937-40c8-bef6-65ed20d12431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:17.692392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bfa585-a937-40c8-bef6-65ed20d12431 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:17.693161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfa585-a937-40c8-bef6-65ed20d12431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:17.695170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bfa585-a937-40c8-bef6-65ed20d12431 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:17.754681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 912/1810] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:17 2022] POST /identity/v3/projects => generated 354 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:17.756316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58261bf5-ba74-41e4-bfd4-b85c98ad7578 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:17.777642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 899/1811] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:17 2022] POST /identity/v3/projects => generated 405 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:17.780805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfa585-a937-40c8-bef6-65ed20d12431 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:17.876047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58261bf5-ba74-41e4-bfd4-b85c98ad7578 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:17.889762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bfa585-a937-40c8-bef6-65ed20d12431 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:17.895763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eaf36-964e-4efb-89ca-2bb3047b0e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:17.896481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eaf36-964e-4efb-89ca-2bb3047b0e91 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:17.896762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eaf36-964e-4efb-89ca-2bb3047b0e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:17.897032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3eaf36-964e-4efb-89ca-2bb3047b0e91 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:17.898304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eaf36-964e-4efb-89ca-2bb3047b0e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:17.901641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3eaf36-964e-4efb-89ca-2bb3047b0e91 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:17.929425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 900/1812] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:17 2022] POST /identity/v3/users => generated 309 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:17.933378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eaf36-964e-4efb-89ca-2bb3047b0e91 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:17.943470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3eaf36-964e-4efb-89ca-2bb3047b0e91 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:17.948071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44aa75-b59c-4917-a151-c87d0ea82577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:17.948702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44aa75-b59c-4917-a151-c87d0ea82577 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:17.948980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44aa75-b59c-4917-a151-c87d0ea82577 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:17.949769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44aa75-b59c-4917-a151-c87d0ea82577 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:17.950575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44aa75-b59c-4917-a151-c87d0ea82577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:17.950997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdc8efb77a8c4284ba788ce7e011fd21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145181602fd14864a24c918bf0688650', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:17.951735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:17.952127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:17.952266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44aa75-b59c-4917-a151-c87d0ea82577 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:17.952617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:17.953472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:17.954726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:17.956978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:17.969475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 901/1813] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:17.973432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44aa75-b59c-4917-a151-c87d0ea82577 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:17.983351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 913/1814] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:17.984601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44aa75-b59c-4917-a151-c87d0ea82577 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:17.985860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:17.993102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4c6f5-bda0-4814-9ab2-73f96fd2f4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:17.994101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4c6f5-bda0-4814-9ab2-73f96fd2f4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:17.994791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4c6f5-bda0-4814-9ab2-73f96fd2f4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:17.995410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4c6f5-bda0-4814-9ab2-73f96fd2f4d7 admin admin] PATH_INFO: `/v3/projects/672bf3610fa541638ffa8e44b1faa324/users/a5a09610085e46fcbec1369a57037ea4/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:18.016460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4c6f5-bda0-4814-9ab2-73f96fd2f4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=672bf3610fa541638ffa8e44b1faa324, user_id=a5a09610085e46fcbec1369a57037ea4, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:18.019502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4c6f5-bda0-4814-9ab2-73f96fd2f4d7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:18.040518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 902/1815] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:17 2022] PUT /identity/v3/projects/672bf3610fa541638ffa8e44b1faa324/users/a5a09610085e46fcbec1369a57037ea4/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:18.042586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:18.057015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef2b237-599c-42af-9ae4-9d3f20ab1451 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:18.062544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4c6f5-bda0-4814-9ab2-73f96fd2f4d7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:18.067877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:18.130976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3ba4-aef4-40e0-a419-141db0a72556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:18.131993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3ba4-aef4-40e0-a419-141db0a72556 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:18.132524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3ba4-aef4-40e0-a419-141db0a72556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:18.133027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e3ba4-aef4-40e0-a419-141db0a72556 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:18.134139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3ba4-aef4-40e0-a419-141db0a72556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:18.136157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e3ba4-aef4-40e0-a419-141db0a72556 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:18.148586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 914/1816] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:18.151899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4c6f5-bda0-4814-9ab2-73f96fd2f4d7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:18.153872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3ba4-aef4-40e0-a419-141db0a72556 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:18.159765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdc8efb77a8c4284ba788ce7e011fd21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '145181602fd14864a24c918bf0688650', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:18.160674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:18.160965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:18.161283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] PATH_INFO: `/v3/projects/85091293afae484b88e01ac8a4ce846a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:18.162680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=85091293afae484b88e01ac8a4ce846a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:18.164703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:18.168571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e3ba4-aef4-40e0-a419-141db0a72556 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:18.174101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:18.174982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:18.175399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:18.175679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] PATH_INFO: `/v3/projects/672bf3610fa541638ffa8e44b1faa324/users/a5a09610085e46fcbec1369a57037ea4/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:18.177957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=672bf3610fa541638ffa8e44b1faa324, user_id=a5a09610085e46fcbec1369a57037ea4, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:18.181791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:18.199838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 915/1817] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:18 2022] PUT /identity/v3/projects/672bf3610fa541638ffa8e44b1faa324/users/a5a09610085e46fcbec1369a57037ea4/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:18.200451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:18.202381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:18.232883 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85091293afae484b88e01ac8a4ce846a', 'request_id': 'req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.245261 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85091293afae484b88e01ac8a4ce846a', 'request_id': 'req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.271135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85091293afae484b88e01ac8a4ce846a', 'request_id': 'req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.294282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] The token cache is being invalidate because project 85091293afae484b88e01ac8a4ce846a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:18.294831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.306773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-aeb4dcd3-13d0-4b80-8bb8-00e0cfbebdd0 tempest-VolumeQuotaClassesTest-1825289445 tempest-VolumeQuotaClassesTest-1825289445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.315206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 903/1818] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:18 2022] DELETE /identity/v3/projects/85091293afae484b88e01ac8a4ce846a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:18.338540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c631a656-2dde-4fba-be83-790477007d3e admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:18.364235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe7b1-4d1c-48e7-bc2d-109a3ca28322 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:18.364527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe7b1-4d1c-48e7-bc2d-109a3ca28322 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:18.364734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794fe7b1-4d1c-48e7-bc2d-109a3ca28322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:18.406561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-794fe7b1-4d1c-48e7-bc2d-109a3ca28322 None None] MFA Rules not processed for user `d5f210085ee04473b2808f0a2dfc37ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:18.407426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-794fe7b1-4d1c-48e7-bc2d-109a3ca28322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:18.448297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:18.448852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:18.449371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:18.450033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] PATH_INFO: `/v3/projects/315de11ff2644f1594032c20a08879bf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:18.451696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] RBAC: Authorizing `identity:delete_project(project_id=315de11ff2644f1594032c20a08879bf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:18.455283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:18.591981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:18.596613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '315de11ff2644f1594032c20a08879bf', 'request_id': 'req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.619615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 904/1819] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:18.625022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '315de11ff2644f1594032c20a08879bf', 'request_id': 'req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.648396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '315de11ff2644f1594032c20a08879bf', 'request_id': 'req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.692368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] The token cache is being invalidate because project 315de11ff2644f1594032c20a08879bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:18.692675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.696831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:18.706078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 916/1820] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:18 2022] DELETE /identity/v3/projects/315de11ff2644f1594032c20a08879bf => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:18.707350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe7b1-4d1c-48e7-bc2d-109a3ca28322 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:18.710211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-794fe7b1-4d1c-48e7-bc2d-109a3ca28322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:18.738288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794fe7b1-4d1c-48e7-bc2d-109a3ca28322 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:18.772453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:18.810615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:18.812383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:18.896946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:18.897881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:18.898228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:18.898679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] PATH_INFO: `/v3/users/b95d92b4a9414256bb3269c74573d79b` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:18.901538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95d92b4a9414256bb3269c74573d79b)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:18.906159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:18.973994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a70a41d-a8ad-4bd2-8620-a4e816d6629f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:18.981890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:18.982845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:18.983298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:18.983783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] PATH_INFO: `/v3/users/d8daceadb31a4cf99a76dd203bd07e08` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:18.989772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8daceadb31a4cf99a76dd203bd07e08)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:18.999336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:19.012901 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95d92b4a9414256bb3269c74573d79b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.050470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95d92b4a9414256bb3269c74573d79b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.052581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95d92b4a9414256bb3269c74573d79b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.057022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95d92b4a9414256bb3269c74573d79b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.084007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-752f10e4-cf91-4028-9dad-02b88064946f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95d92b4a9414256bb3269c74573d79b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.145671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 905/1821] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:18 2022] DELETE /identity/v3/users/b95d92b4a9414256bb3269c74573d79b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:19.153832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb4b9-ac06-4508-8b5c-7b5aaee725a2 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:19.154100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb4b9-ac06-4508-8b5c-7b5aaee725a2 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:19.154379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17eb4b9-ac06-4508-8b5c-7b5aaee725a2 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:19.162239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 906/1822] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:46:19 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:46:19.180898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8daceadb31a4cf99a76dd203bd07e08'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.183272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8daceadb31a4cf99a76dd203bd07e08'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.195327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525dcfd-4d40-4510-9ad8-18883fee0825 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:19.195523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525dcfd-4d40-4510-9ad8-18883fee0825 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:19.195737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525dcfd-4d40-4510-9ad8-18883fee0825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:19.228294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8daceadb31a4cf99a76dd203bd07e08'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.260606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0525dcfd-4d40-4510-9ad8-18883fee0825 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:19.262470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0525dcfd-4d40-4510-9ad8-18883fee0825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:19.266955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8daceadb31a4cf99a76dd203bd07e08'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.285395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-43c1d485-c236-497d-9e4d-69566b59e570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8daceadb31a4cf99a76dd203bd07e08'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:19.322804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 917/1823] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:18 2022] DELETE /identity/v3/users/d8daceadb31a4cf99a76dd203bd07e08 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:19.324485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78426f-1ff4-46a4-ad06-7e2c44b2ccf0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:19.324883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78426f-1ff4-46a4-ad06-7e2c44b2ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:19.325209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78426f-1ff4-46a4-ad06-7e2c44b2ccf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:19.372358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bc78426f-1ff4-46a4-ad06-7e2c44b2ccf0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:19.374644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bc78426f-1ff4-46a4-ad06-7e2c44b2ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:19.439250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 907/1824] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:46:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:19.465456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:19.486267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 918/1825] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:19.532141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525dcfd-4d40-4510-9ad8-18883fee0825 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:19.533934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0525dcfd-4d40-4510-9ad8-18883fee0825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:19.595077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:19.659817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525dcfd-4d40-4510-9ad8-18883fee0825 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:19.763869 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78426f-1ff4-46a4-ad06-7e2c44b2ccf0 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:19.766568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f571332-9f59-4b2d-b50b-7244cab3899b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:19.767333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bc78426f-1ff4-46a4-ad06-7e2c44b2ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:19.767448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571332-9f59-4b2d-b50b-7244cab3899b service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:19.767764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571332-9f59-4b2d-b50b-7244cab3899b service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:19.768131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f571332-9f59-4b2d-b50b-7244cab3899b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:19.781950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f571332-9f59-4b2d-b50b-7244cab3899b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:19.784599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f571332-9f59-4b2d-b50b-7244cab3899b service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:19.806408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 908/1826] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:19.882674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78426f-1ff4-46a4-ad06-7e2c44b2ccf0 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:19.889484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:19.890792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:19.891516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:19.891942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:19.904161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:19.906490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:19.927403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 919/1827] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:20.028495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af8c1-abe5-436f-8586-3f7829a82c8c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:20.029251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af8c1-abe5-436f-8586-3f7829a82c8c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:20.029907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022af8c1-abe5-436f-8586-3f7829a82c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:20.119952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-022af8c1-abe5-436f-8586-3f7829a82c8c None None] MFA Rules not processed for user `a5a09610085e46fcbec1369a57037ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:20.122118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-022af8c1-abe5-436f-8586-3f7829a82c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:20.286099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 909/1828] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:20.378181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:20.380046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:20.425727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36796c60-88ea-41c6-ab14-b5790d750fc7 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:20.441000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:20.441671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:20.442012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:20.442266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] PATH_INFO: `/v3/projects/a1b9f67b68364d73b7908ae80a3e2b43` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:20.453087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b9f67b68364d73b7908ae80a3e2b43)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:20.455052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:20.666031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b9f67b68364d73b7908ae80a3e2b43', 'request_id': 'req-9267ab6a-9338-43be-b9b3-fc786b6bb913'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:20.683163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b9f67b68364d73b7908ae80a3e2b43', 'request_id': 'req-9267ab6a-9338-43be-b9b3-fc786b6bb913'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:20.697050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b9f67b68364d73b7908ae80a3e2b43', 'request_id': 'req-9267ab6a-9338-43be-b9b3-fc786b6bb913'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:20.725944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] The token cache is being invalidate because project a1b9f67b68364d73b7908ae80a3e2b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:20.725944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:20.728485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9267ab6a-9338-43be-b9b3-fc786b6bb913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:20.737227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 920/1829] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:20 2022] DELETE /identity/v3/projects/a1b9f67b68364d73b7908ae80a3e2b43 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:20.739472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeb264-78c8-4f44-a078-9e4b63dc00ff None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:20.740013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeb264-78c8-4f44-a078-9e4b63dc00ff None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:20.740013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aeb264-78c8-4f44-a078-9e4b63dc00ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:20.794154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e7aeb264-78c8-4f44-a078-9e4b63dc00ff None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:20.795381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e7aeb264-78c8-4f44-a078-9e4b63dc00ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:20.920237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 910/1830] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:20.928951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0a72-ef69-4f88-b8ef-869f812f7624 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:20.929699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0a72-ef69-4f88-b8ef-869f812f7624 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:20.929955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b0a72-ef69-4f88-b8ef-869f812f7624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:20.995672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aeb264-78c8-4f44-a078-9e4b63dc00ff None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:20.999385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e7aeb264-78c8-4f44-a078-9e4b63dc00ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.010391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-813b0a72-ef69-4f88-b8ef-869f812f7624 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:21.011438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-813b0a72-ef69-4f88-b8ef-869f812f7624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.022947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aeb264-78c8-4f44-a078-9e4b63dc00ff None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.039942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 921/1831] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:21.042812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0a72-ef69-4f88-b8ef-869f812f7624 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.068807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.072777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.073751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.073891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b0a72-ef69-4f88-b8ef-869f812f7624 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.076662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] PATH_INFO: `/v3/projects/6fd1e267d61f4e90b227609ede41c23f` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.079271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd1e267d61f4e90b227609ede41c23f)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.086620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.087673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.088405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.088690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.089007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.090387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:21.091741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.095809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.100493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:21.128289 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 922/1832] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:21.133628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.153448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b208b2-b4a8-43e1-972f-eb80c839e2f2 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.174879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd1e267d61f4e90b227609ede41c23f', 'request_id': 'req-e36195fc-2015-42a5-a651-714c89b402d4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.185732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd1e267d61f4e90b227609ede41c23f', 'request_id': 'req-e36195fc-2015-42a5-a651-714c89b402d4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.194581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd1e267d61f4e90b227609ede41c23f', 'request_id': 'req-e36195fc-2015-42a5-a651-714c89b402d4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.207231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] The token cache is being invalidate because project 6fd1e267d61f4e90b227609ede41c23f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:21.207599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.208378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.210157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 911/1833] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:20 2022] DELETE /identity/v3/projects/6fd1e267d61f4e90b227609ede41c23f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:21.213949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.215725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.222257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:21.260378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.261194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.262409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.262760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.263462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.265453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.296539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36195fc-2015-42a5-a651-714c89b402d4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.302826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 923/1834] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:21 2022] POST /identity/v3/projects => generated 383 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:21.302982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.302982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.302982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.302982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] PATH_INFO: `/v3/users/bdc8efb77a8c4284ba788ce7e011fd21` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.303850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc8efb77a8c4284ba788ce7e011fd21)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.304085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.305745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.305844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.354064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc8efb77a8c4284ba788ce7e011fd21'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.369459 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc8efb77a8c4284ba788ce7e011fd21'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.370354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc8efb77a8c4284ba788ce7e011fd21'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.371418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc8efb77a8c4284ba788ce7e011fd21'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.372213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9fa80-22fa-4aaf-be90-68b39f9bb3a5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.378307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0999e-980f-43f8-be27-a80c6fa3b00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.379096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0999e-980f-43f8-be27-a80c6fa3b00f admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.379440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0999e-980f-43f8-be27-a80c6fa3b00f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.379913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0999e-980f-43f8-be27-a80c6fa3b00f admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.380685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0999e-980f-43f8-be27-a80c6fa3b00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.382573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc8efb77a8c4284ba788ce7e011fd21'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:21.383226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0999e-980f-43f8-be27-a80c6fa3b00f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.399256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 912/1835] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:21 2022] DELETE /identity/v3/users/bdc8efb77a8c4284ba788ce7e011fd21 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:21.408464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 924/1836] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:21 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:21.412419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.413823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.434691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:21.452235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511cf7-a7e1-4885-89ea-3f44b15217cc None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.452538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511cf7-a7e1-4885-89ea-3f44b15217cc None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.453177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511cf7-a7e1-4885-89ea-3f44b15217cc None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.455266 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 925/1837] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:46:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 09:46:21.467734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa21a3-a6a1-4af4-9574-68d8de046cfa None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.468104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa21a3-a6a1-4af4-9574-68d8de046cfa None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.468476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa21a3-a6a1-4af4-9574-68d8de046cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.499204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-1cfa21a3-a6a1-4af4-9574-68d8de046cfa None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:21.500756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1cfa21a3-a6a1-4af4-9574-68d8de046cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.512597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b02a54-8c02-47c6-a2a4-11f5fc8a5b44 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.519678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ddf6b-c760-4603-843d-cbe4234ea5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.521191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddf6b-c760-4603-843d-cbe4234ea5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.521506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddf6b-c760-4603-843d-cbe4234ea5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.521787 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ddf6b-c760-4603-843d-cbe4234ea5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.522753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ddf6b-c760-4603-843d-cbe4234ea5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.524744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ddf6b-c760-4603-843d-cbe4234ea5e1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.538418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 913/1838] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:21.542455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ddf6b-c760-4603-843d-cbe4234ea5e1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.558921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ddf6b-c760-4603-843d-cbe4234ea5e1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.565875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.566530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.566826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.567074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.567736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.583431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.594576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 926/1839] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:46:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:21.599029 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 914/1840] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:21.606109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa21a3-a6a1-4af4-9574-68d8de046cfa None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.616506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.616934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.617690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa21a3-a6a1-4af4-9574-68d8de046cfa None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.623551 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b5618-c123-4355-9eff-dfb0080f14cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.624490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5618-c123-4355-9eff-dfb0080f14cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.624874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5618-c123-4355-9eff-dfb0080f14cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.625213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b5618-c123-4355-9eff-dfb0080f14cd admin admin] PATH_INFO: `/v3/projects/7702464268e74650aeb5640409d72fe0/users/863da5e527354d52b666ac2b7fccdbdf/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.635621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8132ee-e65e-4d97-b04d-f89209b9721d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:21.643113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:21.643743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.644034 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.644487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.645321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b5618-c123-4355-9eff-dfb0080f14cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7702464268e74650aeb5640409d72fe0, user_id=863da5e527354d52b666ac2b7fccdbdf, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.648198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b5618-c123-4355-9eff-dfb0080f14cd admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.656372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:21.658131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:21.687600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 927/1841] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:21 2022] PUT /identity/v3/projects/7702464268e74650aeb5640409d72fe0/users/863da5e527354d52b666ac2b7fccdbdf/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:21.690224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e2a7-0511-4e08-ba2c-650884332a71 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:21.691050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e2a7-0511-4e08-ba2c-650884332a71 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:21.691203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048e2a7-0511-4e08-ba2c-650884332a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:21.704357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 915/1842] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:21.762992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6048e2a7-0511-4e08-ba2c-650884332a71 None None] MFA Rules not processed for user `863da5e527354d52b666ac2b7fccdbdf`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:21.766030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6048e2a7-0511-4e08-ba2c-650884332a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.799003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:21.924589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.928306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:21.951705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 928/1843] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:21.959571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048e2a7-0511-4e08-ba2c-650884332a71 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:21.968823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1d392-61ee-4bc6-9827-083c68d6ed85 service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:22.063278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:22.064906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.065343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.066242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] PATH_INFO: `/v3/users/b156233592684c2495a690503e9c2f09` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.068332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b156233592684c2495a690503e9c2f09)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:22.071393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:22.113225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048e2a7-0511-4e08-ba2c-650884332a71 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:22.120000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:22.122753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.123616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.123936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.124678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:22.126883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:22.148040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b156233592684c2495a690503e9c2f09'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.166715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b156233592684c2495a690503e9c2f09'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.167482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b156233592684c2495a690503e9c2f09'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.168276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b156233592684c2495a690503e9c2f09'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.173485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 929/1844] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:21 2022] POST /identity/v3/projects => generated 381 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:22.175710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:22.179337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:22.180097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b156233592684c2495a690503e9c2f09'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.209956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 916/1845] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:21 2022] DELETE /identity/v3/users/b156233592684c2495a690503e9c2f09 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:22.209956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:22.209956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:22.219586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:22.277876 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118657db-8f20-4806-b96b-68a800c561bb admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:22.321664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7fd39-1fa0-479f-a2f6-b337b2c2d686 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:22.333943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c191a4df-9d7d-4e42-b033-c262877820e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:22.334889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191a4df-9d7d-4e42-b033-c262877820e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.335349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191a4df-9d7d-4e42-b033-c262877820e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.335906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c191a4df-9d7d-4e42-b033-c262877820e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.337070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191a4df-9d7d-4e42-b033-c262877820e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:22.341435 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c191a4df-9d7d-4e42-b033-c262877820e7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:22.369846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:22.373888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 917/1846] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:22 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:22.375600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6227-a8e7-49b4-86f2-d833841615f9 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.375600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6227-a8e7-49b4-86f2-d833841615f9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.375600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a6227-a8e7-49b4-86f2-d833841615f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.403291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:22.403952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.404303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.406799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] PATH_INFO: `/v3/projects/145181602fd14864a24c918bf0688650` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.408144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=145181602fd14864a24c918bf0688650)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:22.412476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:22.418822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-829a6227-a8e7-49b4-86f2-d833841615f9 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:22.420613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-829a6227-a8e7-49b4-86f2-d833841615f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:22.434546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 918/1847] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:22.435623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a6227-a8e7-49b4-86f2-d833841615f9 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:22.449910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a6227-a8e7-49b4-86f2-d833841615f9 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:22.458860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:22.458860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.458860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.458860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.459328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:22.460988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:22.474324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 919/1848] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:22.475780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:22.477918 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:22.544400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '145181602fd14864a24c918bf0688650', 'request_id': 'req-ffaa393d-6e61-450d-8931-0e2475d54155'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.561761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '145181602fd14864a24c918bf0688650', 'request_id': 'req-ffaa393d-6e61-450d-8931-0e2475d54155'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.571029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '145181602fd14864a24c918bf0688650', 'request_id': 'req-ffaa393d-6e61-450d-8931-0e2475d54155'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.594934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] The token cache is being invalidate because project 145181602fd14864a24c918bf0688650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:22.595492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.596407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:22.598234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 930/1849] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:22 2022] DELETE /identity/v3/projects/145181602fd14864a24c918bf0688650 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:22.601806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:22.601806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:22.615489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cbf95d-3b7e-489d-9d4a-5af2c0eceeb5 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:22.725334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa393d-6e61-450d-8931-0e2475d54155 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:22.737690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eeae0e-bab6-4637-96b2-0c88411a22af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:22.738221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeae0e-bab6-4637-96b2-0c88411a22af admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.738498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeae0e-bab6-4637-96b2-0c88411a22af admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.738908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeae0e-bab6-4637-96b2-0c88411a22af admin admin] PATH_INFO: `/v3/projects/c4040f3334384dc9af1e9fd03641af2a/users/f6214236a518492bbe38c7aec70f92c2/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.759607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f7372-cc1a-4ede-8d06-8c97c93e9339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:22.760286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7372-cc1a-4ede-8d06-8c97c93e9339 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.760539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7372-cc1a-4ede-8d06-8c97c93e9339 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.762777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7372-cc1a-4ede-8d06-8c97c93e9339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.765356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d65f7372-cc1a-4ede-8d06-8c97c93e9339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:22.771694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eeae0e-bab6-4637-96b2-0c88411a22af admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4040f3334384dc9af1e9fd03641af2a, user_id=f6214236a518492bbe38c7aec70f92c2, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:22.786819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f7372-cc1a-4ede-8d06-8c97c93e9339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:22.788536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f7372-cc1a-4ede-8d06-8c97c93e9339 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:22.803425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 920/1850] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:22.804599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb9416-ee81-4d9a-857d-bc3f523f2857 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.804899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb9416-ee81-4d9a-857d-bc3f523f2857 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.805267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb9416-ee81-4d9a-857d-bc3f523f2857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.809114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eeae0e-bab6-4637-96b2-0c88411a22af admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:22.834358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d2bb9416-ee81-4d9a-857d-bc3f523f2857 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:22.835707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d2bb9416-ee81-4d9a-857d-bc3f523f2857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:22.848003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 931/1851] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:22 2022] PUT /identity/v3/projects/c4040f3334384dc9af1e9fd03641af2a/users/f6214236a518492bbe38c7aec70f92c2/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:22.849519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9998-23f4-493d-977f-ffa9bef06d8d None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.849916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9998-23f4-493d-977f-ffa9bef06d8d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.850324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea9998-23f4-493d-977f-ffa9bef06d8d None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.852403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 932/1852] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:46:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:46:22.852522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 921/1853] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:22.853600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb9416-ee81-4d9a-857d-bc3f523f2857 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:22.857150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9998-23f4-493d-977f-ffa9bef06d8d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:22.861626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e6ea9998-23f4-493d-977f-ffa9bef06d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:22.873844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb9416-ee81-4d9a-857d-bc3f523f2857 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:22.907619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:22.953374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf04725-2af7-401c-a42e-9c71dafc0c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:22.954629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04725-2af7-401c-a42e-9c71dafc0c76 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.954629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04725-2af7-401c-a42e-9c71dafc0c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.955143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf04725-2af7-401c-a42e-9c71dafc0c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:22.955942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf04725-2af7-401c-a42e-9c71dafc0c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:22.958038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf04725-2af7-401c-a42e-9c71dafc0c76 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:22.978263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 922/1854] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:22.979375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305109-593b-4a70-b1b7-6372782556ac None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:22.979765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305109-593b-4a70-b1b7-6372782556ac None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:22.980139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82305109-593b-4a70-b1b7-6372782556ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.026985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-82305109-593b-4a70-b1b7-6372782556ac None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:23.032312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-82305109-593b-4a70-b1b7-6372782556ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.056510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 923/1855] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:23.058010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d242fd3-9ccf-4332-91d7-b34b29fc3a48 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.059469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d242fd3-9ccf-4332-91d7-b34b29fc3a48 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.061779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d242fd3-9ccf-4332-91d7-b34b29fc3a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.074216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea9998-23f4-493d-977f-ffa9bef06d8d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:23.080211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:23.081094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.081441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.081819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] PATH_INFO: `/v3/users/c21595c4396f46e790b223ada533fda1` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.087903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21595c4396f46e790b223ada533fda1)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:23.091309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:23.097930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3d242fd3-9ccf-4332-91d7-b34b29fc3a48 None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:23.099246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3d242fd3-9ccf-4332-91d7-b34b29fc3a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.102489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:23.177591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21595c4396f46e790b223ada533fda1'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.178844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21595c4396f46e790b223ada533fda1'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.192730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21595c4396f46e790b223ada533fda1'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.209946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 924/1856] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:46:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:23.210939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21595c4396f46e790b223ada533fda1'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.211523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d242fd3-9ccf-4332-91d7-b34b29fc3a48 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:23.213519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3d242fd3-9ccf-4332-91d7-b34b29fc3a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.227023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21595c4396f46e790b223ada533fda1'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.235456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d242fd3-9ccf-4332-91d7-b34b29fc3a48 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:23.240202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 933/1857] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:22 2022] DELETE /identity/v3/users/c21595c4396f46e790b223ada533fda1 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:23.244096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:23.244467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:23.245285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.245680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.246446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.246780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] PATH_INFO: `/v3/projects/c4040f3334384dc9af1e9fd03641af2a/users/f6214236a518492bbe38c7aec70f92c2/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.249443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4040f3334384dc9af1e9fd03641af2a, user_id=f6214236a518492bbe38c7aec70f92c2, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:23.253216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:23.299102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 925/1858] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:23 2022] PUT /identity/v3/projects/c4040f3334384dc9af1e9fd03641af2a/users/f6214236a518492bbe38c7aec70f92c2/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:23.300216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:23.318218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.357538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f6cf7-2282-475a-b004-a5819a5372e3 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:23.471532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1245537-d010-4d7d-9339-542762fb8ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:23.472313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245537-d010-4d7d-9339-542762fb8ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.472660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245537-d010-4d7d-9339-542762fb8ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.473046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1245537-d010-4d7d-9339-542762fb8ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.474317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1245537-d010-4d7d-9339-542762fb8ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:23.474708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1245537-d010-4d7d-9339-542762fb8ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:23.477107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1245537-d010-4d7d-9339-542762fb8ca0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:23.489595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b66ef-bf17-4f19-9deb-3be7cf9fb106 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:23.497395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:23.498614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.498924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.499206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.509882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 934/1859] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:23.511312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e47206-4ecc-4fb2-a1d9-b36e63df4236 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.512684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e47206-4ecc-4fb2-a1d9-b36e63df4236 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.513147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e47206-4ecc-4fb2-a1d9-b36e63df4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.533577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:23.538313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:23.554099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 926/1860] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:23.555043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:23.555339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-06e47206-4ecc-4fb2-a1d9-b36e63df4236 None None] MFA Rules not processed for user `f6214236a518492bbe38c7aec70f92c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:23.556688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.556812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-06e47206-4ecc-4fb2-a1d9-b36e63df4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.572467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125167f-159d-4082-82f4-497045bdb759 service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:23.579017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:23.591768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:23.592588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.592891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.593189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] PATH_INFO: `/v3/projects/968bcc3a3ca644168a41ebabdb76753b` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.595786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968bcc3a3ca644168a41ebabdb76753b)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:23.597931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:23.643254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:23.662703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968bcc3a3ca644168a41ebabdb76753b', 'request_id': 'req-ad13075a-a7f2-4133-88a1-2a81deab8f18'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.666228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 935/1861] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:23.667294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e47206-4ecc-4fb2-a1d9-b36e63df4236 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:23.680582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968bcc3a3ca644168a41ebabdb76753b', 'request_id': 'req-ad13075a-a7f2-4133-88a1-2a81deab8f18'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.688011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e47206-4ecc-4fb2-a1d9-b36e63df4236 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:23.689939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968bcc3a3ca644168a41ebabdb76753b', 'request_id': 'req-ad13075a-a7f2-4133-88a1-2a81deab8f18'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.703634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] The token cache is being invalidate because project 968bcc3a3ca644168a41ebabdb76753b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:23.703928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.704895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.706415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 927/1862] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:23 2022] DELETE /identity/v3/projects/968bcc3a3ca644168a41ebabdb76753b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:23.710545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:23.712279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.753131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:23.753751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.754042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.754319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.754958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:23.756923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:23.789592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 936/1863] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:23 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:23.790594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:23.795597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.809574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13075a-a7f2-4133-88a1-2a81deab8f18 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:23.877528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a935baeb-1e80-4a95-8a87-4bf6cd7b0bb7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:23.877740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:23.878523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.878876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.879219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] PATH_INFO: `/v3/projects/1e297e57c85240d9bb0004e4523df740` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.880482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e297e57c85240d9bb0004e4523df740)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:23.882487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:23.886118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:23.887875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:23.888103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:23.888429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:23.892644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:23.959534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e297e57c85240d9bb0004e4523df740', 'request_id': 'req-d9e01374-9c67-481d-92de-716785652bd3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.965276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:23.974074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e297e57c85240d9bb0004e4523df740', 'request_id': 'req-d9e01374-9c67-481d-92de-716785652bd3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.983063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e297e57c85240d9bb0004e4523df740', 'request_id': 'req-d9e01374-9c67-481d-92de-716785652bd3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:23.984673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:23.985932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:23.987236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.005066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] The token cache is being invalidate because project 1e297e57c85240d9bb0004e4523df740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:24.005340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.006192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.008301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 928/1864] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:23 2022] DELETE /identity/v3/projects/1e297e57c85240d9bb0004e4523df740 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:24.009005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.010622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.015396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 937/1865] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:24.017052 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.019483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.038086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f726d8-c976-49ac-a1c5-ec99d522bc3c service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:24.109881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01374-9c67-481d-92de-716785652bd3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:24.119220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:24.119220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.119220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.119220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] PATH_INFO: `/v3/users/3c80410b72ad4259be7a4959ebf31c87` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.121984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c80410b72ad4259be7a4959ebf31c87)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:24.124433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.146559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:24.146559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.146559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.146559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.147057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:24.148509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.176847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 938/1866] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:24 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:24.178076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.179906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.195953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f94f65-048b-4107-a3a3-ed7eefff5bd9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:24.197343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c80410b72ad4259be7a4959ebf31c87'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.201096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:24.201715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.201995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.202279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] PATH_INFO: `/v3/users/a5a09610085e46fcbec1369a57037ea4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.203523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a09610085e46fcbec1369a57037ea4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:24.205525 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.211356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c80410b72ad4259be7a4959ebf31c87'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.212164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c80410b72ad4259be7a4959ebf31c87'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.212896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c80410b72ad4259be7a4959ebf31c87'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.219804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c80410b72ad4259be7a4959ebf31c87'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.233219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 929/1867] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:24 2022] DELETE /identity/v3/users/3c80410b72ad4259be7a4959ebf31c87 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:24.233840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.235180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.263265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a09610085e46fcbec1369a57037ea4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.263908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a09610085e46fcbec1369a57037ea4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.275934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a09610085e46fcbec1369a57037ea4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.299246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a09610085e46fcbec1369a57037ea4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.307303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a09610085e46fcbec1369a57037ea4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.309783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4336ac8-a0e4-4d2c-ba60-5e19cc12264c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:24.314863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:24.315610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.315930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.316442 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.317148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 939/1868] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:24 2022] DELETE /identity/v3/users/a5a09610085e46fcbec1369a57037ea4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:24.318602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.318825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.319985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.352886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:24.386873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:24.406448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:24.408921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.413174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a572afc-a64b-462e-b896-3ffeccafb72f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:24.423719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2cd75-7402-435f-b050-c2f8084c1535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:24.424320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 930/1869] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:24.424442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cd75-7402-435f-b050-c2f8084c1535 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.425115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cd75-7402-435f-b050-c2f8084c1535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.425398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cd75-7402-435f-b050-c2f8084c1535 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.426059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2cd75-7402-435f-b050-c2f8084c1535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:24.427971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2cd75-7402-435f-b050-c2f8084c1535 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.446875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 940/1870] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:24.447072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.560426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25383372-9e6a-4cc0-ae27-e75a725a8d79 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:24.567328 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:24.567945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.568389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.568664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.570134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:24.571669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.587043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 931/1871] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:24 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:24.591218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2cd75-7402-435f-b050-c2f8084c1535 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.602753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2cd75-7402-435f-b050-c2f8084c1535 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:24.616319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e4231-60ea-44c1-8c8b-6142d354b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:24.617634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4231-60ea-44c1-8c8b-6142d354b44b admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.618088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4231-60ea-44c1-8c8b-6142d354b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.618417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e4231-60ea-44c1-8c8b-6142d354b44b admin admin] PATH_INFO: `/v3/projects/8d19d40c2836438bacdc0f5104d089d9/users/abddc06c0cc443d2940ab16dd5df9547/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.641244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4231-60ea-44c1-8c8b-6142d354b44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d19d40c2836438bacdc0f5104d089d9, user_id=abddc06c0cc443d2940ab16dd5df9547, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:24.644523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e4231-60ea-44c1-8c8b-6142d354b44b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.644907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.646944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.664022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237612e-2179-43b3-ad05-7e30969b17fa admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:24.679380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 941/1872] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:24 2022] PUT /identity/v3/projects/8d19d40c2836438bacdc0f5104d089d9/users/abddc06c0cc443d2940ab16dd5df9547/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:24.690544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d89b-7c07-4a5f-a236-baf2d0250a47 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.690978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d89b-7c07-4a5f-a236-baf2d0250a47 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.691352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2d89b-7c07-4a5f-a236-baf2d0250a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.748575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-69c2d89b-7c07-4a5f-a236-baf2d0250a47 None None] MFA Rules not processed for user `abddc06c0cc443d2940ab16dd5df9547`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:24.750503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-69c2d89b-7c07-4a5f-a236-baf2d0250a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.771166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:24.772111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:24.772501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:24.772862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] PATH_INFO: `/v3/projects/672bf3610fa541638ffa8e44b1faa324` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:24.774185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] RBAC: Authorizing `identity:delete_project(project_id=672bf3610fa541638ffa8e44b1faa324)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:24.776528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:24.849548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '672bf3610fa541638ffa8e44b1faa324', 'request_id': 'req-014aed2a-c9c6-4520-b5fb-e5d44401778a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.863883 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '672bf3610fa541638ffa8e44b1faa324', 'request_id': 'req-014aed2a-c9c6-4520-b5fb-e5d44401778a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.872381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '672bf3610fa541638ffa8e44b1faa324', 'request_id': 'req-014aed2a-c9c6-4520-b5fb-e5d44401778a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.876224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:24.882050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 942/1873] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:24.883455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2d89b-7c07-4a5f-a236-baf2d0250a47 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.885947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-69c2d89b-7c07-4a5f-a236-baf2d0250a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.901193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] The token cache is being invalidate because project 672bf3610fa541638ffa8e44b1faa324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:24.901543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.902288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:24.907293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 932/1874] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:24 2022] DELETE /identity/v3/projects/672bf3610fa541638ffa8e44b1faa324 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:24.907293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:24.909595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:24.914864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2d89b-7c07-4a5f-a236-baf2d0250a47 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.011221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.012375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.012886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.013198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] PATH_INFO: `/v3/projects/2be6958a17b346949aacba395163f202` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.014625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2be6958a17b346949aacba395163f202)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.016560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.029861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014aed2a-c9c6-4520-b5fb-e5d44401778a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.039655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880490f-4d7c-47ed-8032-d01525d4d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.040531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880490f-4d7c-47ed-8032-d01525d4d923 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.040810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880490f-4d7c-47ed-8032-d01525d4d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.041077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880490f-4d7c-47ed-8032-d01525d4d923 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.041728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880490f-4d7c-47ed-8032-d01525d4d923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.044006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880490f-4d7c-47ed-8032-d01525d4d923 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.089117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2be6958a17b346949aacba395163f202', 'request_id': 'req-7b36a0ec-835e-4600-a5f5-6bdd60505081'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:25.091122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:25.100366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2be6958a17b346949aacba395163f202', 'request_id': 'req-7b36a0ec-835e-4600-a5f5-6bdd60505081'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:25.109421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 933/1875] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:24 2022] POST /identity/v3/projects => generated 397 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:25.109555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2be6958a17b346949aacba395163f202', 'request_id': 'req-7b36a0ec-835e-4600-a5f5-6bdd60505081'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:25.113057 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd3e08-0d37-4d17-ba20-8b2c4bf1d9ea None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.113576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd3e08-0d37-4d17-ba20-8b2c4bf1d9ea None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.113867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd3e08-0d37-4d17-ba20-8b2c4bf1d9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.123485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] The token cache is being invalidate because project 2be6958a17b346949aacba395163f202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:25.123821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:25.124562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:25.130537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 943/1876] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:24 2022] DELETE /identity/v3/projects/2be6958a17b346949aacba395163f202 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:25.130537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.130537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:25.142948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-cffd3e08-0d37-4d17-ba20-8b2c4bf1d9ea None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:25.144310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cffd3e08-0d37-4d17-ba20-8b2c4bf1d9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:25.247679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36a0ec-835e-4600-a5f5-6bdd60505081 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.255768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 934/1877] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:25.260437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2508c-e18b-4992-b1e7-d5a49c18b898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.261140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2508c-e18b-4992-b1e7-d5a49c18b898 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.262484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2508c-e18b-4992-b1e7-d5a49c18b898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.262803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2508c-e18b-4992-b1e7-d5a49c18b898 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.263645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2508c-e18b-4992-b1e7-d5a49c18b898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.265360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efbb3-4357-451a-97b6-1f0a22333b9a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.266237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efbb3-4357-451a-97b6-1f0a22333b9a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.266441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2508c-e18b-4992-b1e7-d5a49c18b898 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.267634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7efbb3-4357-451a-97b6-1f0a22333b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.309941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 944/1878] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/users => generated 305 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:25.315702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5c7efbb3-4357-451a-97b6-1f0a22333b9a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:25.316462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c4ba2-fc26-4c49-9405-690e8785b800 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.316780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c4ba2-fc26-4c49-9405-690e8785b800 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.317204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c4ba2-fc26-4c49-9405-690e8785b800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.317327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5c7efbb3-4357-451a-97b6-1f0a22333b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:25.330817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 935/1879] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:25.332682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7efbb3-4357-451a-97b6-1f0a22333b9a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.349789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7efbb3-4357-451a-97b6-1f0a22333b9a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.350976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c98c4ba2-fc26-4c49-9405-690e8785b800 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:25.352772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c98c4ba2-fc26-4c49-9405-690e8785b800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:25.363910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e516a73-287f-4206-83f5-5901236774be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.364313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 945/1880] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:25.366453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e516a73-287f-4206-83f5-5901236774be admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.366747 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e516a73-287f-4206-83f5-5901236774be admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.367132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e516a73-287f-4206-83f5-5901236774be admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.367769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e516a73-287f-4206-83f5-5901236774be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.368916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3d6d-d974-464f-a1bd-ac4ef546ec9a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.369212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3d6d-d974-464f-a1bd-ac4ef546ec9a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.369467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e516a73-287f-4206-83f5-5901236774be admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.369554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca3d6d-d974-464f-a1bd-ac4ef546ec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.382240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 936/1881] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:25.383221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e516a73-287f-4206-83f5-5901236774be admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.396164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e516a73-287f-4206-83f5-5901236774be admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.396765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6eca3d6d-d974-464f-a1bd-ac4ef546ec9a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:25.398782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6eca3d6d-d974-464f-a1bd-ac4ef546ec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:25.402478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.403145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.403545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.403877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.404639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:25.405017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.408426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.414047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 946/1882] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:25.414962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca3d6d-d974-464f-a1bd-ac4ef546ec9a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.425895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca3d6d-d974-464f-a1bd-ac4ef546ec9a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.427945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 937/1883] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:25.429080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.434967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed478680-3254-4bbc-b7e8-231290738a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.435656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed478680-3254-4bbc-b7e8-231290738a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.435918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed478680-3254-4bbc-b7e8-231290738a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.436218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed478680-3254-4bbc-b7e8-231290738a5d admin admin] PATH_INFO: `/v3/projects/f26ab44ab68746cab3bbec345b4a2b6d/users/259697e850634933b5788f5973f80a41/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.439072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c77f6a-e7b6-4a46-9a1b-82c45abd9b5f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.444321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.444946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.445235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.445508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.446162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:25.446487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.448078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.453947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed478680-3254-4bbc-b7e8-231290738a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26ab44ab68746cab3bbec345b4a2b6d, user_id=259697e850634933b5788f5973f80a41, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.456818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed478680-3254-4bbc-b7e8-231290738a5d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.461593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 938/1884] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:25.462584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.473478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2e1d-a72d-4e2e-9bcf-578ea79ef2b0 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.474767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 947/1885] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:25 2022] PUT /identity/v3/projects/f26ab44ab68746cab3bbec345b4a2b6d/users/259697e850634933b5788f5973f80a41/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:25.476228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed478680-3254-4bbc-b7e8-231290738a5d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.506557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:25.542415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed478680-3254-4bbc-b7e8-231290738a5d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.550781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d23d7-6596-4264-8f0e-1594f6e28a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.551404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d23d7-6596-4264-8f0e-1594f6e28a17 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.551690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d23d7-6596-4264-8f0e-1594f6e28a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.551966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d23d7-6596-4264-8f0e-1594f6e28a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.552936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d23d7-6596-4264-8f0e-1594f6e28a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.554804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d23d7-6596-4264-8f0e-1594f6e28a17 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.560695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae34f-7282-44ea-b09b-816971b35acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.561874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae34f-7282-44ea-b09b-816971b35acb admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.562356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae34f-7282-44ea-b09b-816971b35acb admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.576453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ae34f-7282-44ea-b09b-816971b35acb admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.579369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ae34f-7282-44ea-b09b-816971b35acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.579556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ae34f-7282-44ea-b09b-816971b35acb admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.603678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 948/1886] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:25.604491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d23d7-6596-4264-8f0e-1594f6e28a17 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.632198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:INSERT=6,keystone:DELETE=3,keystone:SELECT=91 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:25.647483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 939/1887] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/projects => generated 355 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:25.648368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae34f-7282-44ea-b09b-816971b35acb admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.738719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d23d7-6596-4264-8f0e-1594f6e28a17 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.787480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ae34f-7282-44ea-b09b-816971b35acb admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.799586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3608-3577-47d4-8ca8-74357bc7c0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.800247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3608-3577-47d4-8ca8-74357bc7c0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.800538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3608-3577-47d4-8ca8-74357bc7c0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.800813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a3608-3577-47d4-8ca8-74357bc7c0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.802758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3608-3577-47d4-8ca8-74357bc7c0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.806257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a3608-3577-47d4-8ca8-74357bc7c0c5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.851358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 940/1888] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/users => generated 289 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:25.858161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3608-3577-47d4-8ca8-74357bc7c0c5 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.872047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b56d8-ce70-4b77-a56a-5ee9b276e963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.872707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b56d8-ce70-4b77-a56a-5ee9b276e963 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.873078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b56d8-ce70-4b77-a56a-5ee9b276e963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.873231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a3608-3577-47d4-8ca8-74357bc7c0c5 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.873352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b56d8-ce70-4b77-a56a-5ee9b276e963 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.874019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b56d8-ce70-4b77-a56a-5ee9b276e963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.875665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b56d8-ce70-4b77-a56a-5ee9b276e963 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.878844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570969c4-f8ff-4dfa-814f-1f85a3dcd4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.879475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570969c4-f8ff-4dfa-814f-1f85a3dcd4fa admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.879758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570969c4-f8ff-4dfa-814f-1f85a3dcd4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.880033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570969c4-f8ff-4dfa-814f-1f85a3dcd4fa admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.880859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570969c4-f8ff-4dfa-814f-1f85a3dcd4fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.883905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570969c4-f8ff-4dfa-814f-1f85a3dcd4fa admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.890581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 949/1889] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:25.890581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b56d8-ce70-4b77-a56a-5ee9b276e963 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.904144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b56d8-ce70-4b77-a56a-5ee9b276e963 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.910232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52826d0f-f8f5-4ef4-bfc9-9ce21b58bd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.910884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 941/1890] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:25 2022] POST /identity/v3/users => generated 278 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:25.911756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826d0f-f8f5-4ef4-bfc9-9ce21b58bd43 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.911875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570969c4-f8ff-4dfa-814f-1f85a3dcd4fa admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.912259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826d0f-f8f5-4ef4-bfc9-9ce21b58bd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.912634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52826d0f-f8f5-4ef4-bfc9-9ce21b58bd43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.913361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52826d0f-f8f5-4ef4-bfc9-9ce21b58bd43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.915759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52826d0f-f8f5-4ef4-bfc9-9ce21b58bd43 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.925223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570969c4-f8ff-4dfa-814f-1f85a3dcd4fa admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:25.936438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521096-7440-4e7a-825f-d1033e8f19e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:25.937529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521096-7440-4e7a-825f-d1033e8f19e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:25.937938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521096-7440-4e7a-825f-d1033e8f19e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:25.938990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d521096-7440-4e7a-825f-d1033e8f19e8 admin admin] PATH_INFO: `/v3/projects/f26ab44ab68746cab3bbec345b4a2b6d/users/259697e850634933b5788f5973f80a41/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:25.942534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521096-7440-4e7a-825f-d1033e8f19e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26ab44ab68746cab3bbec345b4a2b6d, user_id=259697e850634933b5788f5973f80a41, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:25.945492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 950/1891] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:25.945808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d521096-7440-4e7a-825f-d1033e8f19e8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:25.950122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52826d0f-f8f5-4ef4-bfc9-9ce21b58bd43 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.960463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 942/1892] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:25 2022] PUT /identity/v3/projects/f26ab44ab68746cab3bbec345b4a2b6d/users/259697e850634933b5788f5973f80a41/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:25.961490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521096-7440-4e7a-825f-d1033e8f19e8 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:25.961916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52826d0f-f8f5-4ef4-bfc9-9ce21b58bd43 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:26.073836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d521096-7440-4e7a-825f-d1033e8f19e8 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:26.081336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5babdc-7918-46a8-92b3-a0e94132e7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:26.083086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5babdc-7918-46a8-92b3-a0e94132e7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.083357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5babdc-7918-46a8-92b3-a0e94132e7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.083729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5babdc-7918-46a8-92b3-a0e94132e7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.084666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5babdc-7918-46a8-92b3-a0e94132e7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:26.086762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5babdc-7918-46a8-92b3-a0e94132e7f6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:26.101971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 943/1893] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:26.103415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6fd8b-41ed-4718-ab5d-6b410e719307 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.103806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6fd8b-41ed-4718-ab5d-6b410e719307 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.104205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6fd8b-41ed-4718-ab5d-6b410e719307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.114426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a4a16-a57f-4b65-8cf7-546e006b82aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:26.115067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a4a16-a57f-4b65-8cf7-546e006b82aa admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.115354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a4a16-a57f-4b65-8cf7-546e006b82aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.115630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a4a16-a57f-4b65-8cf7-546e006b82aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.117804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a4a16-a57f-4b65-8cf7-546e006b82aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:26.119940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a4a16-a57f-4b65-8cf7-546e006b82aa admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:26.136084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:26.140697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0ea6fd8b-41ed-4718-ab5d-6b410e719307 None None] MFA Rules not processed for user `259697e850634933b5788f5973f80a41`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:26.142373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0ea6fd8b-41ed-4718-ab5d-6b410e719307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:26.153942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 951/1894] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:26.154788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a4a16-a57f-4b65-8cf7-546e006b82aa admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:26.176729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a4a16-a57f-4b65-8cf7-546e006b82aa admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:26.196807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:26.197584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.197947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.198307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] PATH_INFO: `/v3/projects/79ac59422fc842438365cabeb3a7f044/users/17435582b436469daa4fee5bd1066899/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.230646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79ac59422fc842438365cabeb3a7f044, user_id=17435582b436469daa4fee5bd1066899, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:26.239406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:26.244092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 944/1895] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:26 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:26.244092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6fd8b-41ed-4718-ab5d-6b410e719307 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:26.257833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6fd8b-41ed-4718-ab5d-6b410e719307 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:26.265254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366dc22a-92b5-4173-99c2-a69d3d560de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:26.266588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc22a-92b5-4173-99c2-a69d3d560de4 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.267060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc22a-92b5-4173-99c2-a69d3d560de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.267546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366dc22a-92b5-4173-99c2-a69d3d560de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.268414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dc22a-92b5-4173-99c2-a69d3d560de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:26.271196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366dc22a-92b5-4173-99c2-a69d3d560de4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:26.272034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 952/1896] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:26 2022] PUT /identity/v3/projects/79ac59422fc842438365cabeb3a7f044/users/17435582b436469daa4fee5bd1066899/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:26.272933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:26.278763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:26.298327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 945/1897] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:26.301491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94f962-05b8-48dd-9a77-db5ffb035f6a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.301664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94f962-05b8-48dd-9a77-db5ffb035f6a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.301947 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94f962-05b8-48dd-9a77-db5ffb035f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.333721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:26.370482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4b94f962-05b8-48dd-9a77-db5ffb035f6a None None] MFA Rules not processed for user `17435582b436469daa4fee5bd1066899`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:26.372056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4b94f962-05b8-48dd-9a77-db5ffb035f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:26.410166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff9f44-b08b-40db-b4d9-473c29071e08 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:26.424609 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f05a6-10e3-47dc-afe1-532742c3cc90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:26.429506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f05a6-10e3-47dc-afe1-532742c3cc90 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.430152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f05a6-10e3-47dc-afe1-532742c3cc90 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.430642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f05a6-10e3-47dc-afe1-532742c3cc90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.530275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 946/1898] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:26.532474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94f962-05b8-48dd-9a77-db5ffb035f6a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:26.554434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f05a6-10e3-47dc-afe1-532742c3cc90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:26.559452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f05a6-10e3-47dc-afe1-532742c3cc90 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:26.593704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 953/1899] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:26 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:26.624384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94f962-05b8-48dd-9a77-db5ffb035f6a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:26.634897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06740e02-321b-43ed-a016-fb2c446c0a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:26.635958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740e02-321b-43ed-a016-fb2c446c0a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.637249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740e02-321b-43ed-a016-fb2c446c0a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.637868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06740e02-321b-43ed-a016-fb2c446c0a38 admin admin] PATH_INFO: `/v3/projects/a449a7e81a4a4c27b9f322b37365f823/users/e53c0e506be04991ba68a7828324dd36/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.653334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f05a6-10e3-47dc-afe1-532742c3cc90 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:26.680066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f05a6-10e3-47dc-afe1-532742c3cc90 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:26.681940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06740e02-321b-43ed-a016-fb2c446c0a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a449a7e81a4a4c27b9f322b37365f823, user_id=e53c0e506be04991ba68a7828324dd36, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:26.686513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06740e02-321b-43ed-a016-fb2c446c0a38 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:26.688073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89892ae1-7d3f-46f3-8c94-b9465071371c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:26.689685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89892ae1-7d3f-46f3-8c94-b9465071371c service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.691856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89892ae1-7d3f-46f3-8c94-b9465071371c service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.692624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89892ae1-7d3f-46f3-8c94-b9465071371c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.702021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:26.714635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89892ae1-7d3f-46f3-8c94-b9465071371c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:26.718075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89892ae1-7d3f-46f3-8c94-b9465071371c service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:26.727680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 947/1900] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:26 2022] PUT /identity/v3/projects/a449a7e81a4a4c27b9f322b37365f823/users/e53c0e506be04991ba68a7828324dd36/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:26.729403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8008-8d8c-4b27-8b0c-00e5d6b9b5bf None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:26.729883 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8008-8d8c-4b27-8b0c-00e5d6b9b5bf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:26.730198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8008-8d8c-4b27-8b0c-00e5d6b9b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:26.747321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 954/1901] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:26.784656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f37c8008-8d8c-4b27-8b0c-00e5d6b9b5bf None None] MFA Rules not processed for user `e53c0e506be04991ba68a7828324dd36`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:26.786690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f37c8008-8d8c-4b27-8b0c-00e5d6b9b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:26.911288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 948/1902] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:26.911484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89892ae1-7d3f-46f3-8c94-b9465071371c service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:26.937477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89892ae1-7d3f-46f3-8c94-b9465071371c service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:27.084248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:27.084979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.085263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.085566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.086454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:27.088720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:27.173441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 955/1903] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:26 2022] POST /identity/v3/projects => generated 355 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:27.174636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c8008-8d8c-4b27-8b0c-00e5d6b9b5bf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:27.206246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:27.210585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:27.236899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c8008-8d8c-4b27-8b0c-00e5d6b9b5bf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:27.329570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:27.352686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec10d5e-c8e5-4f33-ad03-802d1e37b2e1 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:27.364734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dda5b-2815-43b9-bffe-89cf5bc76d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:27.369692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dda5b-2815-43b9-bffe-89cf5bc76d84 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.369692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dda5b-2815-43b9-bffe-89cf5bc76d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.369964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dda5b-2815-43b9-bffe-89cf5bc76d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.375872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-250dda5b-2815-43b9-bffe-89cf5bc76d84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:27.417442 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692be05-ad55-460c-8604-001e9c0d8f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:27.418629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692be05-ad55-460c-8604-001e9c0d8f16 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.418915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692be05-ad55-460c-8604-001e9c0d8f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.419197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e692be05-ad55-460c-8604-001e9c0d8f16 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.419855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692be05-ad55-460c-8604-001e9c0d8f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:27.422129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e692be05-ad55-460c-8604-001e9c0d8f16 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:27.472990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 949/1904] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:27 2022] POST /identity/v3/users => generated 284 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:27.482009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692be05-ad55-460c-8604-001e9c0d8f16 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:27.503287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e692be05-ad55-460c-8604-001e9c0d8f16 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:27.530858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e4285-9265-450e-961a-408936142cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:27.531640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4285-9265-450e-961a-408936142cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.531916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4285-9265-450e-961a-408936142cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.532317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e4285-9265-450e-961a-408936142cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.533040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e4285-9265-450e-961a-408936142cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:27.533801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dda5b-2815-43b9-bffe-89cf5bc76d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:27.535309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dda5b-2815-43b9-bffe-89cf5bc76d84 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:27.549569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e4285-9265-450e-961a-408936142cd1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:27.556853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 956/1905] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:27 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:27.560731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f51fc-7cd3-47e5-9146-01752297c4c1 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.561331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f51fc-7cd3-47e5-9146-01752297c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.561613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f51fc-7cd3-47e5-9146-01752297c4c1 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.567474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 957/1906] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:46:27 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:46:27.568212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 950/1907] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:27.572291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f51fc-7cd3-47e5-9146-01752297c4c1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:27.586462 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a910bb8-90c8-43a3-82c9-917f2f205821 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.587229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a910bb8-90c8-43a3-82c9-917f2f205821 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.587229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a910bb8-90c8-43a3-82c9-917f2f205821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.599426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f51fc-7cd3-47e5-9146-01752297c4c1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:27.609423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:27.610130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.610418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.610692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] PATH_INFO: `/v3/projects/c05e0bb70cd04f79914df54a410649f9/users/30156492d0e74fccac75910abda93fd3/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.654724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05e0bb70cd04f79914df54a410649f9, user_id=30156492d0e74fccac75910abda93fd3, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:27.659430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7a910bb8-90c8-43a3-82c9-917f2f205821 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:27.660834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7a910bb8-90c8-43a3-82c9-917f2f205821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:27.676254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:27.711619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 958/1908] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:27 2022] PUT /identity/v3/projects/c05e0bb70cd04f79914df54a410649f9/users/30156492d0e74fccac75910abda93fd3/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:27.712437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:27.714912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:27.834073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:27.853614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 951/1909] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:46:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:27.855053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a910bb8-90c8-43a3-82c9-917f2f205821 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:27.878251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a910bb8-90c8-43a3-82c9-917f2f205821 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:27.883433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:27.884125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.884517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.884847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.885562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:27.888165 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:27.892546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d6ec5-c406-4f58-a9bf-750bbc4cfded admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:27.897745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:27.898391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:27.898668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:27.898971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] PATH_INFO: `/v3/users/863da5e527354d52b666ac2b7fccdbdf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:27.900083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] RBAC: Authorizing `identity:delete_user(user_id=863da5e527354d52b666ac2b7fccdbdf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:27.905442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:27.908419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 952/1910] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:27.909289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:27.910976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:28.017079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '863da5e527354d52b666ac2b7fccdbdf'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:28.018734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '863da5e527354d52b666ac2b7fccdbdf'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:28.038815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '863da5e527354d52b666ac2b7fccdbdf'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:28.065403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '863da5e527354d52b666ac2b7fccdbdf'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:28.067127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328ba16-5bc2-4505-85b7-9654821f9fb8 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:28.068681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:28.086348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c447e-f0ad-4fc0-89bf-45866e94ed01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:28.087213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '863da5e527354d52b666ac2b7fccdbdf'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:28.088646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c447e-f0ad-4fc0-89bf-45866e94ed01 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:28.090398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c447e-f0ad-4fc0-89bf-45866e94ed01 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:28.090799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c447e-f0ad-4fc0-89bf-45866e94ed01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:28.096964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7f3c447e-f0ad-4fc0-89bf-45866e94ed01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:28.103485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 959/1911] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:27 2022] DELETE /identity/v3/users/863da5e527354d52b666ac2b7fccdbdf => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:28.106989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:28.108745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:28.128591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c447e-f0ad-4fc0-89bf-45866e94ed01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:28.133129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c447e-f0ad-4fc0-89bf-45866e94ed01 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:28.170082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 953/1912] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:28.171756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a951-6ec3-4b58-bca7-dbf80499fbb5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:28.172703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a951-6ec3-4b58-bca7-dbf80499fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:28.172703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59a951-6ec3-4b58-bca7-dbf80499fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:28.217184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-dc59a951-6ec3-4b58-bca7-dbf80499fbb5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:28.219027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dc59a951-6ec3-4b58-bca7-dbf80499fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:28.259986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081699-f30d-4d36-8abe-b76cb59352be admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:28.266042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa021e-9ff8-4d42-90ba-92ad76094f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:28.267044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa021e-9ff8-4d42-90ba-92ad76094f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:28.267399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa021e-9ff8-4d42-90ba-92ad76094f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:28.267761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa021e-9ff8-4d42-90ba-92ad76094f04 admin admin] PATH_INFO: `/v3/projects/c05e0bb70cd04f79914df54a410649f9/users/30156492d0e74fccac75910abda93fd3/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:28.270095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa021e-9ff8-4d42-90ba-92ad76094f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05e0bb70cd04f79914df54a410649f9, user_id=30156492d0e74fccac75910abda93fd3, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:28.272944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa021e-9ff8-4d42-90ba-92ad76094f04 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:28.291239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 960/1913] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:28 2022] PUT /identity/v3/projects/c05e0bb70cd04f79914df54a410649f9/users/30156492d0e74fccac75910abda93fd3/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:28.305722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4b40a-a945-4eeb-b1fa-0393eb808271 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:28.306285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4b40a-a945-4eeb-b1fa-0393eb808271 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:28.306506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4b40a-a945-4eeb-b1fa-0393eb808271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:28.310515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 954/1914] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:28.321259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59a951-6ec3-4b58-bca7-dbf80499fbb5 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:28.322927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dc59a951-6ec3-4b58-bca7-dbf80499fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:28.347614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b5c4b40a-a945-4eeb-b1fa-0393eb808271 None None] MFA Rules not processed for user `30156492d0e74fccac75910abda93fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:28.348887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b5c4b40a-a945-4eeb-b1fa-0393eb808271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:28.394274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59a951-6ec3-4b58-bca7-dbf80499fbb5 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:28.433347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:28.435110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 961/1915] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:28.444416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4b40a-a945-4eeb-b1fa-0393eb808271 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:28.446179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b5c4b40a-a945-4eeb-b1fa-0393eb808271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:28.469474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:28.470544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:28.470819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:28.471358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:28.529887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4b40a-a945-4eeb-b1fa-0393eb808271 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:28.535158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d7d13-81bb-4865-8a0b-8dc7f1ba58d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:28.535726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7d13-81bb-4865-8a0b-8dc7f1ba58d9 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:28.536051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7d13-81bb-4865-8a0b-8dc7f1ba58d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:28.536361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d7d13-81bb-4865-8a0b-8dc7f1ba58d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:28.546984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d7d13-81bb-4865-8a0b-8dc7f1ba58d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:28.550860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d7d13-81bb-4865-8a0b-8dc7f1ba58d9 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:28.567232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 962/1916] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:28.573161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:28.575938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:28.592123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 955/1917] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:28.651660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d7d13-81bb-4865-8a0b-8dc7f1ba58d9 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:28.661349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d7d13-81bb-4865-8a0b-8dc7f1ba58d9 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:28.665742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:28.666674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:28.666882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:28.667338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:28.670201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:28.682186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:28.751458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:28.753198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:28.765237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 963/1918] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:29.041118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:29.043316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:29.057226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fe7bfb-fa87-4126-887c-81a22273c526 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:29.062238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:29.062775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:29.063061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:29.063367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] PATH_INFO: `/v3/projects/7702464268e74650aeb5640409d72fe0` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:29.064547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7702464268e74650aeb5640409d72fe0)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:29.066658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:29.118731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7702464268e74650aeb5640409d72fe0', 'request_id': 'req-9afd9033-6c07-4bda-be2e-7be19f29f5b1'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.129562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7702464268e74650aeb5640409d72fe0', 'request_id': 'req-9afd9033-6c07-4bda-be2e-7be19f29f5b1'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.137657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7702464268e74650aeb5640409d72fe0', 'request_id': 'req-9afd9033-6c07-4bda-be2e-7be19f29f5b1'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.149060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] The token cache is being invalidate because project 7702464268e74650aeb5640409d72fe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:29.149345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.149964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.151596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 956/1919] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:29 2022] DELETE /identity/v3/projects/7702464268e74650aeb5640409d72fe0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:29.155429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:29.167953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e8c31-787c-4cc5-aa19-e7bfb861f4c0 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:29.232197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:29.232863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:29.233144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:29.233419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] PATH_INFO: `/v3/users/f6214236a518492bbe38c7aec70f92c2` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:29.234554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6214236a518492bbe38c7aec70f92c2)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:29.236557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:29.307247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6214236a518492bbe38c7aec70f92c2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.308980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6214236a518492bbe38c7aec70f92c2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.324795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6214236a518492bbe38c7aec70f92c2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.338362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6214236a518492bbe38c7aec70f92c2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.350598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a930fdf-04ca-49ed-b95b-12097b4768fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6214236a518492bbe38c7aec70f92c2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.366013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 964/1920] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:29 2022] DELETE /identity/v3/users/f6214236a518492bbe38c7aec70f92c2 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:29.690951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:29.692738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:29.707812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd9033-6c07-4bda-be2e-7be19f29f5b1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:29.814024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3907364-ead3-469b-9356-39688009225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:29.814656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907364-ead3-469b-9356-39688009225e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:29.815046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907364-ead3-469b-9356-39688009225e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:29.815324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3907364-ead3-469b-9356-39688009225e admin admin] PATH_INFO: `/v3/projects/c4040f3334384dc9af1e9fd03641af2a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:29.816695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3907364-ead3-469b-9356-39688009225e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4040f3334384dc9af1e9fd03641af2a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:29.828842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3907364-ead3-469b-9356-39688009225e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:29.840677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:29.937820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e3907364-ead3-469b-9356-39688009225e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4040f3334384dc9af1e9fd03641af2a', 'request_id': 'req-e3907364-ead3-469b-9356-39688009225e'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.958822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e3907364-ead3-469b-9356-39688009225e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4040f3334384dc9af1e9fd03641af2a', 'request_id': 'req-e3907364-ead3-469b-9356-39688009225e'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:29.975666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e3907364-ead3-469b-9356-39688009225e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4040f3334384dc9af1e9fd03641af2a', 'request_id': 'req-e3907364-ead3-469b-9356-39688009225e'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:30.018839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e3907364-ead3-469b-9356-39688009225e admin admin] The token cache is being invalidate because project c4040f3334384dc9af1e9fd03641af2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:30.018839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e3907364-ead3-469b-9356-39688009225e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:30.018839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e3907364-ead3-469b-9356-39688009225e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:30.028389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 957/1921] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:29 2022] DELETE /identity/v3/projects/c4040f3334384dc9af1e9fd03641af2a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:30.034056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca621-7fa8-4707-ac52-495b0934eb87 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.034849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca621-7fa8-4707-ac52-495b0934eb87 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.035271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ca621-7fa8-4707-ac52-495b0934eb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.088429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a87ca621-7fa8-4707-ac52-495b0934eb87 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:30.093328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a87ca621-7fa8-4707-ac52-495b0934eb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:30.130358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:30.194773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 965/1922] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:30.205426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff79ff-0024-4e85-a7ee-b65720aee1d1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.205426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff79ff-0024-4e85-a7ee-b65720aee1d1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.205617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff79ff-0024-4e85-a7ee-b65720aee1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.251129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c2ff79ff-0024-4e85-a7ee-b65720aee1d1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:30.254657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c2ff79ff-0024-4e85-a7ee-b65720aee1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:30.282254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 958/1923] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:30.287122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca621-7fa8-4707-ac52-495b0934eb87 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:30.301239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ca621-7fa8-4707-ac52-495b0934eb87 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:30.311077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:30.312348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.312888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.313387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.314977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:30.315507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:30.317917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:30.356157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 966/1924] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:30.357508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff79ff-0024-4e85-a7ee-b65720aee1d1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:30.377235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff79ff-0024-4e85-a7ee-b65720aee1d1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:30.383818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf9e0-87b1-44d5-99ae-889593ee157e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:30.384557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf9e0-87b1-44d5-99ae-889593ee157e admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.384886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf9e0-87b1-44d5-99ae-889593ee157e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.385335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cdf9e0-87b1-44d5-99ae-889593ee157e admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.386833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdf9e0-87b1-44d5-99ae-889593ee157e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:30.389291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cdf9e0-87b1-44d5-99ae-889593ee157e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:30.442326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 959/1925] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:30 2022] POST /identity/v3/projects => generated 409 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:30.444949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:30.460602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12208f07-3d35-481f-b840-456af4cb662f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:30.580347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2218a07-c5ad-4bb4-8332-352c4e497f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:30.581193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218a07-c5ad-4bb4-8332-352c4e497f25 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.581303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218a07-c5ad-4bb4-8332-352c4e497f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.581506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2218a07-c5ad-4bb4-8332-352c4e497f25 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.582155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2218a07-c5ad-4bb4-8332-352c4e497f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:30.595616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2218a07-c5ad-4bb4-8332-352c4e497f25 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:30.646101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 967/1926] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:30 2022] POST /identity/v3/users => generated 305 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:30.652756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf9e0-87b1-44d5-99ae-889593ee157e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:30.696567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cdf9e0-87b1-44d5-99ae-889593ee157e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:30.722349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c86d48-1b29-407c-94c4-108756d6a607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:30.722983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86d48-1b29-407c-94c4-108756d6a607 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.723271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86d48-1b29-407c-94c4-108756d6a607 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.727776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86d48-1b29-407c-94c4-108756d6a607 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.735324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c86d48-1b29-407c-94c4-108756d6a607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:30.742166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c86d48-1b29-407c-94c4-108756d6a607 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:30.773510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 960/1927] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:30.777705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2218a07-c5ad-4bb4-8332-352c4e497f25 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:30.788197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2218a07-c5ad-4bb4-8332-352c4e497f25 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:30.794422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bea75d-e70f-40ad-9bc4-edc6fa323c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:30.795033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea75d-e70f-40ad-9bc4-edc6fa323c0d admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.795312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea75d-e70f-40ad-9bc4-edc6fa323c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.795832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bea75d-e70f-40ad-9bc4-edc6fa323c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.796507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bea75d-e70f-40ad-9bc4-edc6fa323c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:30.798109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bea75d-e70f-40ad-9bc4-edc6fa323c0d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:30.814127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 968/1928] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:30.815186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c86d48-1b29-407c-94c4-108756d6a607 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:30.833844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c86d48-1b29-407c-94c4-108756d6a607 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:30.841572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29da81-10d2-46b1-9218-875494668126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:30.842243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29da81-10d2-46b1-9218-875494668126 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.842684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29da81-10d2-46b1-9218-875494668126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.842963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29da81-10d2-46b1-9218-875494668126 admin admin] PATH_INFO: `/v3/projects/124a4fb1d4844a039df77e2b6376c03f/users/c27453a39c8f45329d40710b668fb312/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.860391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29da81-10d2-46b1-9218-875494668126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124a4fb1d4844a039df77e2b6376c03f, user_id=c27453a39c8f45329d40710b668fb312, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:30.863110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29da81-10d2-46b1-9218-875494668126 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:30.877657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 961/1929] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:30 2022] PUT /identity/v3/projects/124a4fb1d4844a039df77e2b6376c03f/users/c27453a39c8f45329d40710b668fb312/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:30.888383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8daa7f-06e8-4032-9c5b-1f0ba9b8f20e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:30.888677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8daa7f-06e8-4032-9c5b-1f0ba9b8f20e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:30.888983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8daa7f-06e8-4032-9c5b-1f0ba9b8f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:30.917724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0c8daa7f-06e8-4032-9c5b-1f0ba9b8f20e None None] MFA Rules not processed for user `c27453a39c8f45329d40710b668fb312`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:30.919125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0c8daa7f-06e8-4032-9c5b-1f0ba9b8f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:30.986579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 969/1930] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:30 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:30.991353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29da81-10d2-46b1-9218-875494668126 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:31.057162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29da81-10d2-46b1-9218-875494668126 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:31.063387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c997b-b6e4-4d77-92bc-4fa44f91dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:31.063862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c997b-b6e4-4d77-92bc-4fa44f91dab8 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:31.064141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c997b-b6e4-4d77-92bc-4fa44f91dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:31.064427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c997b-b6e4-4d77-92bc-4fa44f91dab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:31.065128 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c997b-b6e4-4d77-92bc-4fa44f91dab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:31.067110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1c997b-b6e4-4d77-92bc-4fa44f91dab8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:31.094614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 962/1931] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:30 2022] POST /identity/v3/projects => generated 407 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:31.099194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8daa7f-06e8-4032-9c5b-1f0ba9b8f20e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:31.112090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8daa7f-06e8-4032-9c5b-1f0ba9b8f20e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:31.152597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:31.210354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908ee14-7569-460d-a0ab-55f516f67155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:31.211036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ee14-7569-460d-a0ab-55f516f67155 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:31.211454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ee14-7569-460d-a0ab-55f516f67155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:31.211832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4908ee14-7569-460d-a0ab-55f516f67155 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:31.212645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908ee14-7569-460d-a0ab-55f516f67155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:31.214835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4908ee14-7569-460d-a0ab-55f516f67155 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:31.237956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 970/1932] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:31 2022] POST /identity/v3/users => generated 310 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:31.242073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c997b-b6e4-4d77-92bc-4fa44f91dab8 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:31.253381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c997b-b6e4-4d77-92bc-4fa44f91dab8 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:31.258444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e10d-b891-4556-9d84-8a7833d1e98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:31.259088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e10d-b891-4556-9d84-8a7833d1e98a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:31.259458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e10d-b891-4556-9d84-8a7833d1e98a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:31.259785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e10d-b891-4556-9d84-8a7833d1e98a admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:31.260620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1e10d-b891-4556-9d84-8a7833d1e98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:31.262790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd1e10d-b891-4556-9d84-8a7833d1e98a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:31.274336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 963/1933] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:31.278719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908ee14-7569-460d-a0ab-55f516f67155 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:31.294801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4908ee14-7569-460d-a0ab-55f516f67155 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:31.300644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165e1d-4a6d-4d1c-a9f0-60504d813979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:31.301451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165e1d-4a6d-4d1c-a9f0-60504d813979 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:31.301804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165e1d-4a6d-4d1c-a9f0-60504d813979 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:31.302151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d165e1d-4a6d-4d1c-a9f0-60504d813979 admin admin] PATH_INFO: `/v3/projects/2e3dd45177cd4db786f29753375eb5df/users/f27fdc54b02842d4ade3f3b8d9f678d4/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:31.324715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d165e1d-4a6d-4d1c-a9f0-60504d813979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3dd45177cd4db786f29753375eb5df, user_id=f27fdc54b02842d4ade3f3b8d9f678d4, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:31.327416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d165e1d-4a6d-4d1c-a9f0-60504d813979 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:31.349532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 971/1934] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:31 2022] PUT /identity/v3/projects/2e3dd45177cd4db786f29753375eb5df/users/f27fdc54b02842d4ade3f3b8d9f678d4/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:31.354900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e10d-b891-4556-9d84-8a7833d1e98a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:31.362337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:31.367745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e10d-b891-4556-9d84-8a7833d1e98a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:31.457727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3219bae9-ba70-4b30-b1e7-d33bd7a127e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:31.459007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219bae9-ba70-4b30-b1e7-d33bd7a127e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:31.459137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219bae9-ba70-4b30-b1e7-d33bd7a127e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:31.459510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3219bae9-ba70-4b30-b1e7-d33bd7a127e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:31.460222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219bae9-ba70-4b30-b1e7-d33bd7a127e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:31.462756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3219bae9-ba70-4b30-b1e7-d33bd7a127e0 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:31.480323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 964/1935] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:31 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:31.484881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165e1d-4a6d-4d1c-a9f0-60504d813979 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:31.524913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d165e1d-4a6d-4d1c-a9f0-60504d813979 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:31.543322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:31.544134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:31.544453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:31.544735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] PATH_INFO: `/v3/projects/2e3dd45177cd4db786f29753375eb5df/users/f27fdc54b02842d4ade3f3b8d9f678d4/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:31.548772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3dd45177cd4db786f29753375eb5df, user_id=f27fdc54b02842d4ade3f3b8d9f678d4, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:31.551087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:31.571102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 972/1936] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:31 2022] PUT /identity/v3/projects/2e3dd45177cd4db786f29753375eb5df/users/f27fdc54b02842d4ade3f3b8d9f678d4/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:31.581779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126b063-96c4-4b90-b2ad-25787829cf5e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:31.582263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126b063-96c4-4b90-b2ad-25787829cf5e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:31.583075 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126b063-96c4-4b90-b2ad-25787829cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:31.622175 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2126b063-96c4-4b90-b2ad-25787829cf5e None None] MFA Rules not processed for user `f27fdc54b02842d4ade3f3b8d9f678d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:31.626170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2126b063-96c4-4b90-b2ad-25787829cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:31.763099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 965/1937] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:31 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:31.870380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:31.872846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:31.994094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27441a-494e-465b-b1b4-c142c75d3177 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:32.007111 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:32.007908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:32.008483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:32.008835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:32.042182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:32.045967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:32.062501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 973/1938] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:31 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:32.366268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126b063-96c4-4b90-b2ad-25787829cf5e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:32.367830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2126b063-96c4-4b90-b2ad-25787829cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:32.408916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:32.410396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:32.422004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c48a9-c73f-4224-9434-515f149ec139 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:32.425955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61851-7b66-432b-83da-c43913ea967d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:32.426652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61851-7b66-432b-83da-c43913ea967d service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:32.427026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61851-7b66-432b-83da-c43913ea967d service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:32.427395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61851-7b66-432b-83da-c43913ea967d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:32.438440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126b063-96c4-4b90-b2ad-25787829cf5e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:32.442999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:32.443631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:32.443913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:32.444216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] PATH_INFO: `/v3/users/abddc06c0cc443d2940ab16dd5df9547` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:32.445356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=abddc06c0cc443d2940ab16dd5df9547)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:32.447277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:32.479664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:32.492489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61851-7b66-432b-83da-c43913ea967d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:32.494031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61851-7b66-432b-83da-c43913ea967d service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:32.498121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abddc06c0cc443d2940ab16dd5df9547'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:32.503706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 974/1939] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:32 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:32.510066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abddc06c0cc443d2940ab16dd5df9547'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:32.512798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abddc06c0cc443d2940ab16dd5df9547'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:32.513102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abddc06c0cc443d2940ab16dd5df9547'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:32.521929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abddc06c0cc443d2940ab16dd5df9547'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:32.535227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 966/1940] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:32 2022] DELETE /identity/v3/users/abddc06c0cc443d2940ab16dd5df9547 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:32.539788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21da2-ce9f-4540-9f60-09e7ed03e19d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:32.540322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21da2-ce9f-4540-9f60-09e7ed03e19d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:32.540669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca21da2-ce9f-4540-9f60-09e7ed03e19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:32.561794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-eca21da2-ce9f-4540-9f60-09e7ed03e19d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:32.563173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-eca21da2-ce9f-4540-9f60-09e7ed03e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:32.577764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:32.632380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 975/1941] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:32.643473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:32.648296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:32.719845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0acb66-aaa9-48d5-a8f8-563cc5b095bf admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:32.725757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e36ac-b2a6-4593-879d-26f64449e903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:32.725757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e36ac-b2a6-4593-879d-26f64449e903 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:32.726128 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e36ac-b2a6-4593-879d-26f64449e903 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:32.726317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e36ac-b2a6-4593-879d-26f64449e903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:32.736821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e36ac-b2a6-4593-879d-26f64449e903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:32.739014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e36ac-b2a6-4593-879d-26f64449e903 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:32.750975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 967/1942] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:33.279109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca21da2-ce9f-4540-9f60-09e7ed03e19d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:33.280749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-eca21da2-ce9f-4540-9f60-09e7ed03e19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:33.307312 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca21da2-ce9f-4540-9f60-09e7ed03e19d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:33.327641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:33.328352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:33.328828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:33.329207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] PATH_INFO: `/v3/projects/8d19d40c2836438bacdc0f5104d089d9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:33.330715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d19d40c2836438bacdc0f5104d089d9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:33.334565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:33.450790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d19d40c2836438bacdc0f5104d089d9', 'request_id': 'req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.470016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d19d40c2836438bacdc0f5104d089d9', 'request_id': 'req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.482575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d19d40c2836438bacdc0f5104d089d9', 'request_id': 'req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.523178 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] The token cache is being invalidate because project 8d19d40c2836438bacdc0f5104d089d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:33.523453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.524357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.527134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 976/1943] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:33 2022] DELETE /identity/v3/projects/8d19d40c2836438bacdc0f5104d089d9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:33.532056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e36ac-b2a6-4593-879d-26f64449e903 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:33.549023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e36ac-b2a6-4593-879d-26f64449e903 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:33.609953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:33.611503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:33.661211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:33.661981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:33.662467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:33.662845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] PATH_INFO: `/v3/users/259697e850634933b5788f5973f80a41` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:33.664457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] RBAC: Authorizing `identity:delete_user(user_id=259697e850634933b5788f5973f80a41)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:33.666463 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:33.718300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f1440-2dcf-491d-a6bf-bfc0cca367cf admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:33.725709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:33.726886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:33.727320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:33.727738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] PATH_INFO: `/v3/users/d73bfaf743ed4039b7127fbee22bf5a9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:33.731567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73bfaf743ed4039b7127fbee22bf5a9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:33.735824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:33.755938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259697e850634933b5788f5973f80a41'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.759002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:33.773562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259697e850634933b5788f5973f80a41'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.775163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259697e850634933b5788f5973f80a41'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.777282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259697e850634933b5788f5973f80a41'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.789296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3e277029-a11f-48ba-b2ab-1ed3897e859c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259697e850634933b5788f5973f80a41'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.805752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 968/1944] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:33 2022] DELETE /identity/v3/users/259697e850634933b5788f5973f80a41 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:33.808434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:33.810707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73bfaf743ed4039b7127fbee22bf5a9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.811428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73bfaf743ed4039b7127fbee22bf5a9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.819935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73bfaf743ed4039b7127fbee22bf5a9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.836738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73bfaf743ed4039b7127fbee22bf5a9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.845286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73bfaf743ed4039b7127fbee22bf5a9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:33.853486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 977/1945] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:33 2022] DELETE /identity/v3/users/d73bfaf743ed4039b7127fbee22bf5a9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:33.858759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b020580-a58f-4c14-84aa-4a1343c4accc None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:33.859272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b020580-a58f-4c14-84aa-4a1343c4accc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:33.859722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b020580-a58f-4c14-84aa-4a1343c4accc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:33.887773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7b020580-a58f-4c14-84aa-4a1343c4accc None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:33.889430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7b020580-a58f-4c14-84aa-4a1343c4accc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:34.018202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 969/1946] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:34.031343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:34.033304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:34.132235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80493e3-5c3c-4248-8461-5ebb434317bb admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:34.144454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599645f-49a0-4b46-a4cf-35728356d064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:34.145091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599645f-49a0-4b46-a4cf-35728356d064 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:34.145376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599645f-49a0-4b46-a4cf-35728356d064 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:34.145660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599645f-49a0-4b46-a4cf-35728356d064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:34.171815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599645f-49a0-4b46-a4cf-35728356d064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:34.173766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599645f-49a0-4b46-a4cf-35728356d064 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:34.186037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 978/1947] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:34.318428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b020580-a58f-4c14-84aa-4a1343c4accc None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:34.320643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7b020580-a58f-4c14-84aa-4a1343c4accc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:34.356769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b020580-a58f-4c14-84aa-4a1343c4accc None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:34.364069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:34.395566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:34.396324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:34.397335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] PATH_INFO: `/v3/projects/f26ab44ab68746cab3bbec345b4a2b6d` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:34.402662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26ab44ab68746cab3bbec345b4a2b6d)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:34.404960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:34.536816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26ab44ab68746cab3bbec345b4a2b6d', 'request_id': 'req-dcee1543-5c6d-47c9-81f5-86fb44fb0959'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:34.554448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26ab44ab68746cab3bbec345b4a2b6d', 'request_id': 'req-dcee1543-5c6d-47c9-81f5-86fb44fb0959'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:34.563291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26ab44ab68746cab3bbec345b4a2b6d', 'request_id': 'req-dcee1543-5c6d-47c9-81f5-86fb44fb0959'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:34.576031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] The token cache is being invalidate because project f26ab44ab68746cab3bbec345b4a2b6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:34.576380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:34.577186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-dcee1543-5c6d-47c9-81f5-86fb44fb0959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:34.579470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 970/1948] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:34 2022] DELETE /identity/v3/projects/f26ab44ab68746cab3bbec345b4a2b6d => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:34.586793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6442edb-e62f-4d41-8945-fe0aaa85795b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:34.587469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6442edb-e62f-4d41-8945-fe0aaa85795b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:34.588035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6442edb-e62f-4d41-8945-fe0aaa85795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:34.651927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a6442edb-e62f-4d41-8945-fe0aaa85795b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:34.658777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a6442edb-e62f-4d41-8945-fe0aaa85795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:34.812488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 979/1949] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:34.818449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318bfb-7643-4118-924b-5ec94f31c96a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:34.819151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318bfb-7643-4118-924b-5ec94f31c96a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:34.819594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b318bfb-7643-4118-924b-5ec94f31c96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:34.873232 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6442edb-e62f-4d41-8945-fe0aaa85795b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:34.874989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a6442edb-e62f-4d41-8945-fe0aaa85795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:34.880450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6b318bfb-7643-4118-924b-5ec94f31c96a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:34.882157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6b318bfb-7643-4118-924b-5ec94f31c96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:34.893141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6442edb-e62f-4d41-8945-fe0aaa85795b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:34.909595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:34.910467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:34.910947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:34.912114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] PATH_INFO: `/v3/projects/bf68376e1bd840fc92e6631cd72bf505` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:34.913843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf68376e1bd840fc92e6631cd72bf505)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:34.923043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 971/1950] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:34.924751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b318bfb-7643-4118-924b-5ec94f31c96a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:34.927692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:34.939671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b318bfb-7643-4118-924b-5ec94f31c96a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:34.951890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:34.952616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:34.952964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:34.953306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:34.954189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:34.955039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:34.957131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:34.972818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 972/1951] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:34.980105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:34.991765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad76a8-d75a-4dfe-9658-6c0dcbe48594 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.000500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b7e51-72a4-4e99-ac64-5ed3c68b5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.001649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7e51-72a4-4e99-ac64-5ed3c68b5a29 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.002038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7e51-72a4-4e99-ac64-5ed3c68b5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.002413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b7e51-72a4-4e99-ac64-5ed3c68b5a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.003208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b7e51-72a4-4e99-ac64-5ed3c68b5a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.005849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b7e51-72a4-4e99-ac64-5ed3c68b5a29 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.031991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf68376e1bd840fc92e6631cd72bf505', 'request_id': 'req-5442d06a-9763-4107-a71e-3f7e5c57b2ff'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.067669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf68376e1bd840fc92e6631cd72bf505', 'request_id': 'req-5442d06a-9763-4107-a71e-3f7e5c57b2ff'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.068507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 973/1952] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:34 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:35.072572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b7e51-72a4-4e99-ac64-5ed3c68b5a29 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.074457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf68376e1bd840fc92e6631cd72bf505', 'request_id': 'req-5442d06a-9763-4107-a71e-3f7e5c57b2ff'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.076617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:35.090073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:35.092375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] The token cache is being invalidate because project bf68376e1bd840fc92e6631cd72bf505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:35.093286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.094433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.098399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 980/1953] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:34 2022] DELETE /identity/v3/projects/bf68376e1bd840fc92e6631cd72bf505 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:35.101766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.103348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:35.157410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b7e51-72a4-4e99-ac64-5ed3c68b5a29 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.161952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.162564 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.163004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.163415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.163997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.166331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.185568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442d06a-9763-4107-a71e-3f7e5c57b2ff admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.191228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.194615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.194741 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 974/1954] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:35 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:35.194837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.194837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] PATH_INFO: `/v3/users/db42ebc7be5b4e9080d26cf3cb5603ef` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.194837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db42ebc7be5b4e9080d26cf3cb5603ef)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.196057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.197613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.199868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:35.212348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c16b7c-2532-455e-82e4-3b87994ed8f0 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.217997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f0fb1-4030-4358-9b03-457f86c0f20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.218593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0fb1-4030-4358-9b03-457f86c0f20c admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.218873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0fb1-4030-4358-9b03-457f86c0f20c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.219141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f0fb1-4030-4358-9b03-457f86c0f20c admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.219774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f0fb1-4030-4358-9b03-457f86c0f20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.221621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f0fb1-4030-4358-9b03-457f86c0f20c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.235348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 975/1955] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:35.236675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f0fb1-4030-4358-9b03-457f86c0f20c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.248067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f0fb1-4030-4358-9b03-457f86c0f20c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.249746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db42ebc7be5b4e9080d26cf3cb5603ef'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.250560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db42ebc7be5b4e9080d26cf3cb5603ef'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.252802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.253928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.254395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.254774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.255563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.257281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.265830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db42ebc7be5b4e9080d26cf3cb5603ef'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.269502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 976/1956] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:35.273893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.275667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:35.282114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db42ebc7be5b4e9080d26cf3cb5603ef'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.291264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b4eee-1c3c-4a7b-967a-f1ea26ded36e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.294175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-fa6c5be0-32f1-4627-987b-d111a79ff705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db42ebc7be5b4e9080d26cf3cb5603ef'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.299882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1f720-bae4-4bd7-8e87-f0f126b5f934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.300586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1f720-bae4-4bd7-8e87-f0f126b5f934 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.300877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1f720-bae4-4bd7-8e87-f0f126b5f934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.301345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1f720-bae4-4bd7-8e87-f0f126b5f934 admin admin] PATH_INFO: `/v3/projects/1ae7046747b84d5c8133d931f8fdf1b1/users/3994e3de6b9a4278990da649275457a9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.301469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 981/1957] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:35 2022] DELETE /identity/v3/users/db42ebc7be5b4e9080d26cf3cb5603ef => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:35.322486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1f720-bae4-4bd7-8e87-f0f126b5f934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae7046747b84d5c8133d931f8fdf1b1, user_id=3994e3de6b9a4278990da649275457a9, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.326013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1f720-bae4-4bd7-8e87-f0f126b5f934 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.347145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 977/1958] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:35 2022] PUT /identity/v3/projects/1ae7046747b84d5c8133d931f8fdf1b1/users/3994e3de6b9a4278990da649275457a9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:35.359088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f720d-7123-40c9-991d-ebb182b4f975 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.359497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f720d-7123-40c9-991d-ebb182b4f975 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.359784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f720d-7123-40c9-991d-ebb182b4f975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.398417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-053f720d-7123-40c9-991d-ebb182b4f975 None None] MFA Rules not processed for user `3994e3de6b9a4278990da649275457a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:35.400051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-053f720d-7123-40c9-991d-ebb182b4f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:35.491228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:35.503138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 982/1959] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:35.504359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1f720-bae4-4bd7-8e87-f0f126b5f934 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.592925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1f720-bae4-4bd7-8e87-f0f126b5f934 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.600540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669e249-14da-43cb-8c94-10d249aa3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.601177 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e249-14da-43cb-8c94-10d249aa3dcf admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.601529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e249-14da-43cb-8c94-10d249aa3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.601822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669e249-14da-43cb-8c94-10d249aa3dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.602573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669e249-14da-43cb-8c94-10d249aa3dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.606309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669e249-14da-43cb-8c94-10d249aa3dcf admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.627655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f720d-7123-40c9-991d-ebb182b4f975 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.630136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-053f720d-7123-40c9-991d-ebb182b4f975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:35.646801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f720d-7123-40c9-991d-ebb182b4f975 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.652086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.652853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.653138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.653418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] PATH_INFO: `/v3/projects/1d1992e2ee6544c3969102e7c7c245bf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.654568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1992e2ee6544c3969102e7c7c245bf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.656634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.673682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 978/1960] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:35 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:35.677853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669e249-14da-43cb-8c94-10d249aa3dcf admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.725422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1992e2ee6544c3969102e7c7c245bf', 'request_id': 'req-f186acc5-c5bc-4e23-99f2-7becd880f910'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.733193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:35.734539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1992e2ee6544c3969102e7c7c245bf', 'request_id': 'req-f186acc5-c5bc-4e23-99f2-7becd880f910'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.745837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1992e2ee6544c3969102e7c7c245bf', 'request_id': 'req-f186acc5-c5bc-4e23-99f2-7becd880f910'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.763706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669e249-14da-43cb-8c94-10d249aa3dcf admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.769138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] The token cache is being invalidate because project 1d1992e2ee6544c3969102e7c7c245bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:35.769593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.771204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f186acc5-c5bc-4e23-99f2-7becd880f910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:35.773932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 983/1961] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:35 2022] DELETE /identity/v3/projects/1d1992e2ee6544c3969102e7c7c245bf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:35.779297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b3eac-a8b5-4300-bc7c-43df07fe6c47 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.779595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b3eac-a8b5-4300-bc7c-43df07fe6c47 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.779877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b3eac-a8b5-4300-bc7c-43df07fe6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.809772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-cb2b3eac-a8b5-4300-bc7c-43df07fe6c47 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:35.811158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cb2b3eac-a8b5-4300-bc7c-43df07fe6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:35.851986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.853201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.853660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.854611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.854890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.857280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.905816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 984/1962] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:35.913976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e29f3-4fc1-4084-84ce-5579ef7f8b22 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.914197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e29f3-4fc1-4084-84ce-5579ef7f8b22 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.914848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e29f3-4fc1-4084-84ce-5579ef7f8b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.932534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 979/1963] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:35 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:35.935305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.940777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:35.946515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-669e29f3-4fc1-4084-84ce-5579ef7f8b22 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:35.947825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-669e29f3-4fc1-4084-84ce-5579ef7f8b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:35.959718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bcbec-7e0c-4109-92fe-86998dc1005e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.962022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 985/1964] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:35.967799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e29f3-4fc1-4084-84ce-5579ef7f8b22 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:35.978205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e29f3-4fc1-4084-84ce-5579ef7f8b22 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:35.982662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83489e90-4477-4f25-83de-7ed773000dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.983739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:35.984252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83489e90-4477-4f25-83de-7ed773000dcd admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.984379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:35.984660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.985012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.985733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:35.986181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83489e90-4477-4f25-83de-7ed773000dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:35.986487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.987170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83489e90-4477-4f25-83de-7ed773000dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:35.988473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83489e90-4477-4f25-83de-7ed773000dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:35.989124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:35.991769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83489e90-4477-4f25-83de-7ed773000dcd admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.008108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 986/1965] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:36.008880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 980/1966] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:36.009000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.013654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83489e90-4477-4f25-83de-7ed773000dcd admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.024796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83489e90-4477-4f25-83de-7ed773000dcd admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.029662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9cd4-cbef-4ee5-baf9-0841731eac2d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.036102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8a9ae-9add-4ad2-ba18-1d2440f14878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.037384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a9ae-9add-4ad2-ba18-1d2440f14878 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.037780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a9ae-9add-4ad2-ba18-1d2440f14878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.038813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8a9ae-9add-4ad2-ba18-1d2440f14878 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.041678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8a9ae-9add-4ad2-ba18-1d2440f14878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.045479 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8a9ae-9add-4ad2-ba18-1d2440f14878 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.046581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba79c56-2467-4350-a3e9-15ab054fddbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.048815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79c56-2467-4350-a3e9-15ab054fddbf admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.049013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79c56-2467-4350-a3e9-15ab054fddbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.051269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba79c56-2467-4350-a3e9-15ab054fddbf admin admin] PATH_INFO: `/v3/projects/19786825c8e44faa8500a427737b6016/users/05fd3547cb5c4e838ab56770050f3484/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.082939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba79c56-2467-4350-a3e9-15ab054fddbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=19786825c8e44faa8500a427737b6016, user_id=05fd3547cb5c4e838ab56770050f3484, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.086259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba79c56-2467-4350-a3e9-15ab054fddbf admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.098844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 987/1967] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:36 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:36.102875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8a9ae-9add-4ad2-ba18-1d2440f14878 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.108218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 981/1968] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:36 2022] PUT /identity/v3/projects/19786825c8e44faa8500a427737b6016/users/05fd3547cb5c4e838ab56770050f3484/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:36.112026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba79c56-2467-4350-a3e9-15ab054fddbf admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.178702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:36.204324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8a9ae-9add-4ad2-ba18-1d2440f14878 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.226040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba79c56-2467-4350-a3e9-15ab054fddbf admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.231631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d7285-3757-471c-a535-2d8ae693476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.232120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7285-3757-471c-a535-2d8ae693476f admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.233286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7285-3757-471c-a535-2d8ae693476f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.233286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7285-3757-471c-a535-2d8ae693476f admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.234321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d7285-3757-471c-a535-2d8ae693476f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.235939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505d7285-3757-471c-a535-2d8ae693476f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.260373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 982/1969] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:36.267613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d7285-3757-471c-a535-2d8ae693476f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.292569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d7285-3757-471c-a535-2d8ae693476f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.301858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f79d52-743d-40af-9b14-3e4d90f0b847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.302487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f79d52-743d-40af-9b14-3e4d90f0b847 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.302768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f79d52-743d-40af-9b14-3e4d90f0b847 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.303044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f79d52-743d-40af-9b14-3e4d90f0b847 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.303683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f79d52-743d-40af-9b14-3e4d90f0b847 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.306022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f79d52-743d-40af-9b14-3e4d90f0b847 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.312811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc82f4-eb16-4a3e-9f5a-3bc7277f8450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.313922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc82f4-eb16-4a3e-9f5a-3bc7277f8450 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.314281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc82f4-eb16-4a3e-9f5a-3bc7277f8450 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.314636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc82f4-eb16-4a3e-9f5a-3bc7277f8450 admin admin] PATH_INFO: `/v3/projects/19786825c8e44faa8500a427737b6016/users/05fd3547cb5c4e838ab56770050f3484/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.324967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc82f4-eb16-4a3e-9f5a-3bc7277f8450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19786825c8e44faa8500a427737b6016, user_id=05fd3547cb5c4e838ab56770050f3484, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.329489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc82f4-eb16-4a3e-9f5a-3bc7277f8450 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.348824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 988/1970] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:36 2022] POST /identity/v3/users => generated 282 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:36.360290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f79d52-743d-40af-9b14-3e4d90f0b847 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.360568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 983/1971] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:36 2022] PUT /identity/v3/projects/19786825c8e44faa8500a427737b6016/users/05fd3547cb5c4e838ab56770050f3484/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:36.365644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c722bdf-73c8-4497-9285-c9df142476c0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.366573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c722bdf-73c8-4497-9285-c9df142476c0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.367015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c722bdf-73c8-4497-9285-c9df142476c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.368767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f79d52-743d-40af-9b14-3e4d90f0b847 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.409744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5c722bdf-73c8-4497-9285-c9df142476c0 None None] MFA Rules not processed for user `05fd3547cb5c4e838ab56770050f3484`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:36.411938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5c722bdf-73c8-4497-9285-c9df142476c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:36.425826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:36.455881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4899d84-8777-403a-b19b-62a7e2dfd663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.457075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899d84-8777-403a-b19b-62a7e2dfd663 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.457367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899d84-8777-403a-b19b-62a7e2dfd663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.457687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4899d84-8777-403a-b19b-62a7e2dfd663 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.458795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4899d84-8777-403a-b19b-62a7e2dfd663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.461257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4899d84-8777-403a-b19b-62a7e2dfd663 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.476732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 989/1972] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:36.481133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4899d84-8777-403a-b19b-62a7e2dfd663 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.493366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4899d84-8777-403a-b19b-62a7e2dfd663 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.500279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cde0b-832b-4da5-9ba5-9f03840dd1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.501026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cde0b-832b-4da5-9ba5-9f03840dd1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.501397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cde0b-832b-4da5-9ba5-9f03840dd1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.501773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cde0b-832b-4da5-9ba5-9f03840dd1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.502606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cde0b-832b-4da5-9ba5-9f03840dd1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.504758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5cde0b-832b-4da5-9ba5-9f03840dd1e8 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.520803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 990/1973] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:36.523504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 984/1974] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:36.525397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cde0b-832b-4da5-9ba5-9f03840dd1e8 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.537857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c722bdf-73c8-4497-9285-c9df142476c0 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.539721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5c722bdf-73c8-4497-9285-c9df142476c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:36.540844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cde0b-832b-4da5-9ba5-9f03840dd1e8 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.546272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6505c5ba-c5b8-4da9-ae59-3d382e0925fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.547117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505c5ba-c5b8-4da9-ae59-3d382e0925fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.547472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505c5ba-c5b8-4da9-ae59-3d382e0925fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.547883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505c5ba-c5b8-4da9-ae59-3d382e0925fa admin admin] PATH_INFO: `/v3/projects/207d0e3c2a4749fe8fc6efda65af4441/users/fd3f0d8c312546e5885103f373a630c6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.566726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505c5ba-c5b8-4da9-ae59-3d382e0925fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=207d0e3c2a4749fe8fc6efda65af4441, user_id=fd3f0d8c312546e5885103f373a630c6, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.569556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6505c5ba-c5b8-4da9-ae59-3d382e0925fa admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.588215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 991/1975] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:36 2022] PUT /identity/v3/projects/207d0e3c2a4749fe8fc6efda65af4441/users/fd3f0d8c312546e5885103f373a630c6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:36.599669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec779d-f0f6-4d40-ac57-2da71bcb713b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.599960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec779d-f0f6-4d40-ac57-2da71bcb713b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.600756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec779d-f0f6-4d40-ac57-2da71bcb713b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.622256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c722bdf-73c8-4497-9285-c9df142476c0 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.637770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-d5ec779d-f0f6-4d40-ac57-2da71bcb713b None None] MFA Rules not processed for user `fd3f0d8c312546e5885103f373a630c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:36.639721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d5ec779d-f0f6-4d40-ac57-2da71bcb713b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:36.680794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:36.687791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389b28a-fff8-414c-89f6-3a2c3650f483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.688495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389b28a-fff8-414c-89f6-3a2c3650f483 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.688782 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389b28a-fff8-414c-89f6-3a2c3650f483 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.689061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7389b28a-fff8-414c-89f6-3a2c3650f483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.733182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 992/1976] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:36.741884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec779d-f0f6-4d40-ac57-2da71bcb713b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.773556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389b28a-fff8-414c-89f6-3a2c3650f483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.775255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7389b28a-fff8-414c-89f6-3a2c3650f483 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.788980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 985/1977] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:36.817223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec779d-f0f6-4d40-ac57-2da71bcb713b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.822563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639384d-347e-4806-951f-584cbb4f1b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.823888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639384d-347e-4806-951f-584cbb4f1b92 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.824317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639384d-347e-4806-951f-584cbb4f1b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.824566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639384d-347e-4806-951f-584cbb4f1b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.825278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639384d-347e-4806-951f-584cbb4f1b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.827354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d639384d-347e-4806-951f-584cbb4f1b92 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.857384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 993/1978] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:36 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:36.863040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389b28a-fff8-414c-89f6-3a2c3650f483 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.871272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639384d-347e-4806-951f-584cbb4f1b92 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.875287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7389b28a-fff8-414c-89f6-3a2c3650f483 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.884520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:36.927664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639384d-347e-4806-951f-584cbb4f1b92 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.931414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.932017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.932328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.933175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.935067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:36.936014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e166bd-d9fc-4565-92da-0fcd5d15b0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.936649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e166bd-d9fc-4565-92da-0fcd5d15b0b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.936934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e166bd-d9fc-4565-92da-0fcd5d15b0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.937207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e166bd-d9fc-4565-92da-0fcd5d15b0b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.937841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e166bd-d9fc-4565-92da-0fcd5d15b0b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.939865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e166bd-d9fc-4565-92da-0fcd5d15b0b3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.962915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 986/1979] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:36 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:36.967074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e166bd-d9fc-4565-92da-0fcd5d15b0b3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:36.977030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e166bd-d9fc-4565-92da-0fcd5d15b0b3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:36.981682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eca6c-fa0f-4f7a-af3e-c43247a1bb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:36.982298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eca6c-fa0f-4f7a-af3e-c43247a1bb29 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:36.982619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eca6c-fa0f-4f7a-af3e-c43247a1bb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:36.982898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eca6c-fa0f-4f7a-af3e-c43247a1bb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:36.983537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eca6c-fa0f-4f7a-af3e-c43247a1bb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:36.985196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3eca6c-fa0f-4f7a-af3e-c43247a1bb29 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:36.995816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 987/1980] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:36.999734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eca6c-fa0f-4f7a-af3e-c43247a1bb29 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:37.001108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:37.002639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:37.011806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eca6c-fa0f-4f7a-af3e-c43247a1bb29 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:37.012702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 994/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:37.017097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5f9c-c3ef-48d2-83c5-f17dc8324dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:37.017798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5f9c-c3ef-48d2-83c5-f17dc8324dde admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:37.018068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5f9c-c3ef-48d2-83c5-f17dc8324dde admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:37.018342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d5f9c-c3ef-48d2-83c5-f17dc8324dde admin admin] PATH_INFO: `/v3/projects/a9695ef3cafe490abb781c94a683a959/users/1b3fbde71bee4b3da7068cc60be2285c/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:37.038740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d5f9c-c3ef-48d2-83c5-f17dc8324dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9695ef3cafe490abb781c94a683a959, user_id=1b3fbde71bee4b3da7068cc60be2285c, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:37.042349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d5f9c-c3ef-48d2-83c5-f17dc8324dde admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:37.066842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 988/1982] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:36 2022] PUT /identity/v3/projects/a9695ef3cafe490abb781c94a683a959/users/1b3fbde71bee4b3da7068cc60be2285c/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:37.068458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:37.081414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea2dca-54eb-4f0f-b723-9318688078a7 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:37.086412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:37.180932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c171cfe-622a-47e1-8403-b5340d6c7d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:37.182436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c171cfe-622a-47e1-8403-b5340d6c7d6e admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:37.183883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c171cfe-622a-47e1-8403-b5340d6c7d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:37.184482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c171cfe-622a-47e1-8403-b5340d6c7d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:37.187163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c171cfe-622a-47e1-8403-b5340d6c7d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:37.190099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c171cfe-622a-47e1-8403-b5340d6c7d6e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:37.204408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 995/1983] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:37.208359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5f9c-c3ef-48d2-83c5-f17dc8324dde admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:37.244497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d5f9c-c3ef-48d2-83c5-f17dc8324dde admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:37.281504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674c68d-ffa1-4dd6-b1fa-380caf5732ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:37.282326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c68d-ffa1-4dd6-b1fa-380caf5732ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:37.282697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c68d-ffa1-4dd6-b1fa-380caf5732ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:37.283026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674c68d-ffa1-4dd6-b1fa-380caf5732ca admin admin] PATH_INFO: `/v3/projects/a9695ef3cafe490abb781c94a683a959/users/1b3fbde71bee4b3da7068cc60be2285c/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:37.287510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674c68d-ffa1-4dd6-b1fa-380caf5732ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9695ef3cafe490abb781c94a683a959, user_id=1b3fbde71bee4b3da7068cc60be2285c, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:37.292067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d674c68d-ffa1-4dd6-b1fa-380caf5732ca admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:37.340291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 989/1984] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:37 2022] PUT /identity/v3/projects/a9695ef3cafe490abb781c94a683a959/users/1b3fbde71bee4b3da7068cc60be2285c/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:37.343693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654cef-f9d4-40bf-a4e2-83246cd6176d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:37.343883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654cef-f9d4-40bf-a4e2-83246cd6176d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:37.344006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d654cef-f9d4-40bf-a4e2-83246cd6176d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:37.405560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2d654cef-f9d4-40bf-a4e2-83246cd6176d None None] MFA Rules not processed for user `1b3fbde71bee4b3da7068cc60be2285c`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:37.406867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2d654cef-f9d4-40bf-a4e2-83246cd6176d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:37.501759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674c68d-ffa1-4dd6-b1fa-380caf5732ca admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:37.589278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 996/1985] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:37.666258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674c68d-ffa1-4dd6-b1fa-380caf5732ca admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:37.681256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:37.682022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:37.682934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:37.683439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] PATH_INFO: `/v3/users/3994e3de6b9a4278990da649275457a9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:37.685368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3994e3de6b9a4278990da649275457a9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:37.692671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:37.701655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654cef-f9d4-40bf-a4e2-83246cd6176d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:37.785544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3994e3de6b9a4278990da649275457a9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:37.789526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d654cef-f9d4-40bf-a4e2-83246cd6176d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:37.796584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda20d4-de99-4b15-b51c-7985837e47d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:37.797264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda20d4-de99-4b15-b51c-7985837e47d1 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:37.797501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda20d4-de99-4b15-b51c-7985837e47d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:37.800309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda20d4-de99-4b15-b51c-7985837e47d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:37.804308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:37.821958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3994e3de6b9a4278990da649275457a9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:37.824913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3994e3de6b9a4278990da649275457a9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:37.826769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3994e3de6b9a4278990da649275457a9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:37.828338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda20d4-de99-4b15-b51c-7985837e47d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:37.829821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda20d4-de99-4b15-b51c-7985837e47d1 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:37.861356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 997/1986] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:37.864165 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3994e3de6b9a4278990da649275457a9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:37.890355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 990/1987] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:37 2022] DELETE /identity/v3/users/3994e3de6b9a4278990da649275457a9 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:37.893163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd7d8-0f16-44c0-9173-f79c44ea2005 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:37.893463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd7d8-0f16-44c0-9173-f79c44ea2005 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:37.894438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdd7d8-0f16-44c0-9173-f79c44ea2005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:37.921661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a7bdd7d8-0f16-44c0-9173-f79c44ea2005 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:37.923486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a7bdd7d8-0f16-44c0-9173-f79c44ea2005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:37.961694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:37.970081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:37.972720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:38.032454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 998/1988] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:38.046399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd7d8-0f16-44c0-9173-f79c44ea2005 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:38.048354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a7bdd7d8-0f16-44c0-9173-f79c44ea2005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:38.072757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a05b8-a41a-4e33-a753-265c826be7a7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:38.078653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:38.079278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:38.079565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:38.079841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:38.082231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:38.126916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdd7d8-0f16-44c0-9173-f79c44ea2005 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:38.131321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:38.131989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:38.132441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:38.132964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:38.142994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:38.144473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:38.161422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 999/1989] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:38.162969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:38.164849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:38.176380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 991/1990] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:38.544264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:38.546193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:38.566343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adcec0-6c86-4ca4-a9fd-b15c3fe29573 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:38.578408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:38.579218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:38.579323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:38.579520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:38.579958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] PATH_INFO: `/v3/projects/1ae7046747b84d5c8133d931f8fdf1b1` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:38.580677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:38.581182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae7046747b84d5c8133d931f8fdf1b1)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:38.583125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:38.594424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66fc232-919c-4654-bd98-6448e8c000f6 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:38.599042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:38.599673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:38.600003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:38.600347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] PATH_INFO: `/v3/users/c27453a39c8f45329d40710b668fb312` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:38.601485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27453a39c8f45329d40710b668fb312)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:38.603400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:38.633924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae7046747b84d5c8133d931f8fdf1b1', 'request_id': 'req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.640971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae7046747b84d5c8133d931f8fdf1b1', 'request_id': 'req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.647581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae7046747b84d5c8133d931f8fdf1b1', 'request_id': 'req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.654657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27453a39c8f45329d40710b668fb312'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.659559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] The token cache is being invalidate because project 1ae7046747b84d5c8133d931f8fdf1b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:38.659855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.660563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.662065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1000/1991] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:38 2022] DELETE /identity/v3/projects/1ae7046747b84d5c8133d931f8fdf1b1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:38.670766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:38.671281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27453a39c8f45329d40710b668fb312'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.671953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27453a39c8f45329d40710b668fb312'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.672597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27453a39c8f45329d40710b668fb312'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.672730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:38.679986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ce3fa22-61e5-47d6-ba56-e53e209d650b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27453a39c8f45329d40710b668fb312'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.688920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:38.694058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 992/1992] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:38 2022] DELETE /identity/v3/users/c27453a39c8f45329d40710b668fb312 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:38.700133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53a49-3648-4bb3-9d4b-3f5ab8cced0b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:38.700724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53a49-3648-4bb3-9d4b-3f5ab8cced0b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:38.701181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d53a49-3648-4bb3-9d4b-3f5ab8cced0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:38.721421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e1d53a49-3648-4bb3-9d4b-3f5ab8cced0b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:38.722804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e1d53a49-3648-4bb3-9d4b-3f5ab8cced0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:38.746723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:38.751657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90847d77-c2ee-4bb2-a235-4a88ee9b8d55 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:38.788070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 993/1993] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:38.798560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d53a49-3648-4bb3-9d4b-3f5ab8cced0b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:38.799993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e1d53a49-3648-4bb3-9d4b-3f5ab8cced0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:38.813261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:38.814109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:38.814400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:38.814677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] PATH_INFO: `/v3/users/05fd3547cb5c4e838ab56770050f3484` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:38.815888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fd3547cb5c4e838ab56770050f3484)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:38.817961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:38.859095 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d53a49-3648-4bb3-9d4b-3f5ab8cced0b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:38.862926 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:38.865225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:38.865225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:38.865225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:38.869914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fd3547cb5c4e838ab56770050f3484'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.870595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fd3547cb5c4e838ab56770050f3484'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.881487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fd3547cb5c4e838ab56770050f3484'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.882517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:38.884126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:38.895361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 994/1994] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:38.905985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fd3547cb5c4e838ab56770050f3484'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.913868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fd3547cb5c4e838ab56770050f3484'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:38.928268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1001/1995] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:38 2022] DELETE /identity/v3/users/05fd3547cb5c4e838ab56770050f3484 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:39.390537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:39.392016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:39.413313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76616187-8ef4-400c-bc7e-c0639bf16da7 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:39.488210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:39.489594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:39.489594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:39.489594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] PATH_INFO: `/v3/projects/19786825c8e44faa8500a427737b6016` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:39.490207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=19786825c8e44faa8500a427737b6016)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:39.492132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:39.513742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:39.516117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:39.545879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2224d85b-093f-4a43-937a-537165b887ef admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:39.588558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:39.590739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:39.591189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:39.591648 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] PATH_INFO: `/v3/projects/124a4fb1d4844a039df77e2b6376c03f` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:39.593035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=124a4fb1d4844a039df77e2b6376c03f)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:39.595762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:39.614527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:39.622826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19786825c8e44faa8500a427737b6016', 'request_id': 'req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.639525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19786825c8e44faa8500a427737b6016', 'request_id': 'req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.650862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19786825c8e44faa8500a427737b6016', 'request_id': 'req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.670270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] The token cache is being invalidate because project 19786825c8e44faa8500a427737b6016 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:39.670651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.671581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9c7b3b32-77a9-4430-9a70-1cce372bcd5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.692025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 995/1996] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:39 2022] DELETE /identity/v3/projects/19786825c8e44faa8500a427737b6016 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:39.693756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8916e1-dcec-44f1-866e-98253bd8fadc None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:39.694155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8916e1-dcec-44f1-866e-98253bd8fadc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:39.694517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8916e1-dcec-44f1-866e-98253bd8fadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:39.717473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124a4fb1d4844a039df77e2b6376c03f', 'request_id': 'req-a2e6047b-0266-412d-9982-b969ba27e3ea'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.717982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2e8916e1-dcec-44f1-866e-98253bd8fadc None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:39.719283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2e8916e1-dcec-44f1-866e-98253bd8fadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:39.748227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124a4fb1d4844a039df77e2b6376c03f', 'request_id': 'req-a2e6047b-0266-412d-9982-b969ba27e3ea'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.761728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124a4fb1d4844a039df77e2b6376c03f', 'request_id': 'req-a2e6047b-0266-412d-9982-b969ba27e3ea'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.786772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] The token cache is being invalidate because project 124a4fb1d4844a039df77e2b6376c03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:39.787114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.787927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:39.790081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1002/1997] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:39 2022] DELETE /identity/v3/projects/124a4fb1d4844a039df77e2b6376c03f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:39.794079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:39.796208 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:39.810414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:39.852758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 996/1998] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:39.860219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90e94-ac3f-4875-96d3-39036249a70b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:39.860560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90e94-ac3f-4875-96d3-39036249a70b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:39.860895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb90e94-ac3f-4875-96d3-39036249a70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:39.922491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ccb90e94-ac3f-4875-96d3-39036249a70b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:39.931593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ccb90e94-ac3f-4875-96d3-39036249a70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:39.932871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6047b-0266-412d-9982-b969ba27e3ea admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:39.942487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:39.943357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:39.943768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:39.944149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] PATH_INFO: `/v3/users/f27fdc54b02842d4ade3f3b8d9f678d4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:39.945797 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27fdc54b02842d4ade3f3b8d9f678d4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:39.950629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:39.959085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 997/1999] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:39.964611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb90e94-ac3f-4875-96d3-39036249a70b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:39.991071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb90e94-ac3f-4875-96d3-39036249a70b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:40.005005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:40.005639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.006078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.006364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.007033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:40.013598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:40.015765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:40.033032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27fdc54b02842d4ade3f3b8d9f678d4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.033781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27fdc54b02842d4ade3f3b8d9f678d4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.048397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 998/2000] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:40.049807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27fdc54b02842d4ade3f3b8d9f678d4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.053559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:40.057194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:40.085494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27fdc54b02842d4ade3f3b8d9f678d4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.086485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a93efa-3acb-4271-a7c7-abb2dc47d712 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:40.108341 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b84d1-bc8e-413e-8ee9-ac8ef2c031a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:40.109261 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b84d1-bc8e-413e-8ee9-ac8ef2c031a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.109546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b84d1-bc8e-413e-8ee9-ac8ef2c031a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.110929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b84d1-bc8e-413e-8ee9-ac8ef2c031a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.112515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b84d1-bc8e-413e-8ee9-ac8ef2c031a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:40.118130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b84d1-bc8e-413e-8ee9-ac8ef2c031a3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:40.119770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27fdc54b02842d4ade3f3b8d9f678d4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.136856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1003/2001] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:39 2022] DELETE /identity/v3/users/f27fdc54b02842d4ade3f3b8d9f678d4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:40.224220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 999/2002] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:40 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:40.230765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:40.478385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec31b5c-c25a-4839-b8b5-a62bf1e45c1f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:40.595650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:40.668578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:40.669169 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.669455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.671883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.675526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:40.680093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:40.733473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1004/2003] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:40 2022] POST /identity/v3/users => generated 287 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:40.738301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b84d1-bc8e-413e-8ee9-ac8ef2c031a3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:40.751297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b84d1-bc8e-413e-8ee9-ac8ef2c031a3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:40.757433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b65ebf-03bc-4821-8fcf-1febfce2f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:40.759555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b65ebf-03bc-4821-8fcf-1febfce2f1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.759847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b65ebf-03bc-4821-8fcf-1febfce2f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.760132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b65ebf-03bc-4821-8fcf-1febfce2f1c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.762070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b65ebf-03bc-4821-8fcf-1febfce2f1c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:40.763910 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b65ebf-03bc-4821-8fcf-1febfce2f1c3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:40.785040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:40.790233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:40.798030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1000/2004] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:40.799027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b65ebf-03bc-4821-8fcf-1febfce2f1c3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:40.809170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d41816-cf49-4657-be59-c63c0f4d836d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:40.810839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b65ebf-03bc-4821-8fcf-1febfce2f1c3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:40.815691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3552e5-0350-4387-be5b-2a3d096e4f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:40.816875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:40.817010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3552e5-0350-4387-be5b-2a3d096e4f4d admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.817391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3552e5-0350-4387-be5b-2a3d096e4f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.817724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.817856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3552e5-0350-4387-be5b-2a3d096e4f4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.818136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.818485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] PATH_INFO: `/v3/projects/2e3dd45177cd4db786f29753375eb5df` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.818593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3552e5-0350-4387-be5b-2a3d096e4f4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:40.820236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3dd45177cd4db786f29753375eb5df)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:40.820743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3552e5-0350-4387-be5b-2a3d096e4f4d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:40.822531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:40.850854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1001/2005] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:40.852252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3552e5-0350-4387-be5b-2a3d096e4f4d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:40.870422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3552e5-0350-4387-be5b-2a3d096e4f4d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:40.879872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0902aa2-83e2-4544-9187-04e83ed8696f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:40.880898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0902aa2-83e2-4544-9187-04e83ed8696f admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.881738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0902aa2-83e2-4544-9187-04e83ed8696f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.882298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0902aa2-83e2-4544-9187-04e83ed8696f admin admin] PATH_INFO: `/v3/projects/2879b73c32f14cf1a5a4e609dfd323a9/users/8e0dd9b1866a4c9391f2ce8d45bb76ef/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.899674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0902aa2-83e2-4544-9187-04e83ed8696f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2879b73c32f14cf1a5a4e609dfd323a9, user_id=8e0dd9b1866a4c9391f2ce8d45bb76ef, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:40.903191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0902aa2-83e2-4544-9187-04e83ed8696f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:40.912031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3dd45177cd4db786f29753375eb5df', 'request_id': 'req-bbc04d9c-5b8d-4815-988f-6c28bdad6936'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.921730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1002/2006] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:40 2022] PUT /identity/v3/projects/2879b73c32f14cf1a5a4e609dfd323a9/users/8e0dd9b1866a4c9391f2ce8d45bb76ef/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:40.922889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3dd45177cd4db786f29753375eb5df', 'request_id': 'req-bbc04d9c-5b8d-4815-988f-6c28bdad6936'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.926829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b156f9c-4e28-4421-9d92-ba27822124e3 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.927056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b156f9c-4e28-4421-9d92-ba27822124e3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.927505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b156f9c-4e28-4421-9d92-ba27822124e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.930620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3dd45177cd4db786f29753375eb5df', 'request_id': 'req-bbc04d9c-5b8d-4815-988f-6c28bdad6936'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.946218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] The token cache is being invalidate because project 2e3dd45177cd4db786f29753375eb5df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:40.946643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.947007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9b156f9c-4e28-4421-9d92-ba27822124e3 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:40.947393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-bbc04d9c-5b8d-4815-988f-6c28bdad6936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:40.949115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1005/2007] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:40 2022] DELETE /identity/v3/projects/2e3dd45177cd4db786f29753375eb5df => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:40.949292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9b156f9c-4e28-4421-9d92-ba27822124e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:40.954162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bdb00-2c7c-47b8-a7dc-34f7e93949df None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:40.954522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bdb00-2c7c-47b8-a7dc-34f7e93949df None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:40.955349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bdb00-2c7c-47b8-a7dc-34f7e93949df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:40.978414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-544bdb00-2c7c-47b8-a7dc-34f7e93949df None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:40.980333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-544bdb00-2c7c-47b8-a7dc-34f7e93949df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:41.004548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:41.044145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1003/2008] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:41.054468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b156f9c-4e28-4421-9d92-ba27822124e3 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.056140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9b156f9c-4e28-4421-9d92-ba27822124e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:41.058958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1006/2009] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:41.067385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c727e0-37aa-4f6a-a7b3-081c738254bb None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.067685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c727e0-37aa-4f6a-a7b3-081c738254bb None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.067965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c727e0-37aa-4f6a-a7b3-081c738254bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.092540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-48c727e0-37aa-4f6a-a7b3-081c738254bb None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:41.093841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-48c727e0-37aa-4f6a-a7b3-081c738254bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:41.108034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1007/2010] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:41.112554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c727e0-37aa-4f6a-a7b3-081c738254bb None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.124829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c727e0-37aa-4f6a-a7b3-081c738254bb None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.130121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.130818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.131206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.131728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.132469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:41.132893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.134905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b156f9c-4e28-4421-9d92-ba27822124e3 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.135369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:41.143869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc85bf-753a-4e38-b213-e62521eaa4b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.144667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc85bf-753a-4e38-b213-e62521eaa4b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.144952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc85bf-753a-4e38-b213-e62521eaa4b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.145498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc85bf-753a-4e38-b213-e62521eaa4b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.160525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc85bf-753a-4e38-b213-e62521eaa4b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.162033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc85bf-753a-4e38-b213-e62521eaa4b9 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:41.166183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1008/2011] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:41.169518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.179997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1004/2012] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:41.185400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628f173-91bf-4187-92d3-881d192c63c6 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.191189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a412-d392-49d5-803d-8880cf60c3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.191956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a412-d392-49d5-803d-8880cf60c3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.192423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a412-d392-49d5-803d-8880cf60c3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.192821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18a412-d392-49d5-803d-8880cf60c3e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.193613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18a412-d392-49d5-803d-8880cf60c3e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.197184 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18a412-d392-49d5-803d-8880cf60c3e1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:41.233560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1009/2013] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:41 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:41.237766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc85bf-753a-4e38-b213-e62521eaa4b9 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.248452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc85bf-753a-4e38-b213-e62521eaa4b9 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.329998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86981-6c4a-480b-ac43-80c061f08355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.330917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86981-6c4a-480b-ac43-80c061f08355 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.331217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86981-6c4a-480b-ac43-80c061f08355 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.331477 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b86981-6c4a-480b-ac43-80c061f08355 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.332141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b86981-6c4a-480b-ac43-80c061f08355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.334609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b86981-6c4a-480b-ac43-80c061f08355 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:41.373846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1005/2014] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:41 2022] POST /identity/v3/users => generated 287 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:41.378707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a412-d392-49d5-803d-8880cf60c3e1 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.387842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:41.391851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18a412-d392-49d5-803d-8880cf60c3e1 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.398237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727854bb-925a-4773-bc56-883d1469812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.399089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727854bb-925a-4773-bc56-883d1469812e admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.399416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727854bb-925a-4773-bc56-883d1469812e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.399887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727854bb-925a-4773-bc56-883d1469812e admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.400625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727854bb-925a-4773-bc56-883d1469812e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.403156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727854bb-925a-4773-bc56-883d1469812e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:41.422219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86981-6c4a-480b-ac43-80c061f08355 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.423415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1010/2015] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:41.448533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b86981-6c4a-480b-ac43-80c061f08355 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.458519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cccd5-31dd-4f38-b381-3c3ec83d196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.459729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cccd5-31dd-4f38-b381-3c3ec83d196a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.460098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cccd5-31dd-4f38-b381-3c3ec83d196a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.461918 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cccd5-31dd-4f38-b381-3c3ec83d196a admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.462592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cccd5-31dd-4f38-b381-3c3ec83d196a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.465238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cccd5-31dd-4f38-b381-3c3ec83d196a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:41.488110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1006/2016] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:41.489580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727854bb-925a-4773-bc56-883d1469812e admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.509287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727854bb-925a-4773-bc56-883d1469812e admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.516107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.516904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.517259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.518323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] PATH_INFO: `/v3/projects/4bfbe31ad8f440d5a07bc2248b22daa6/users/dc8e42092f3146d085a58330532a8eb6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.537096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bfbe31ad8f440d5a07bc2248b22daa6, user_id=dc8e42092f3146d085a58330532a8eb6, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.540427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:41.565104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1011/2017] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:41 2022] PUT /identity/v3/projects/4bfbe31ad8f440d5a07bc2248b22daa6/users/dc8e42092f3146d085a58330532a8eb6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:41.578208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077136e7-6716-4e28-bbea-9fc6f14c5d52 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.578493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077136e7-6716-4e28-bbea-9fc6f14c5d52 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.578756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077136e7-6716-4e28-bbea-9fc6f14c5d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.612760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-077136e7-6716-4e28-bbea-9fc6f14c5d52 None None] MFA Rules not processed for user `dc8e42092f3146d085a58330532a8eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:41.614026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-077136e7-6716-4e28-bbea-9fc6f14c5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:41.688631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:41.694968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1007/2018] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:41.716305 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.718095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:41.803596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fdf34-aa3e-4973-9095-d88fecf46d13 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.810527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17e268-e746-4203-823a-64d3576e8a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.811155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17e268-e746-4203-823a-64d3576e8a1b service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.811464 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17e268-e746-4203-823a-64d3576e8a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.811744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17e268-e746-4203-823a-64d3576e8a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.822456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17e268-e746-4203-823a-64d3576e8a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.825189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17e268-e746-4203-823a-64d3576e8a1b service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:41.835268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1012/2019] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:41.861253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077136e7-6716-4e28-bbea-9fc6f14c5d52 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:41.982612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077136e7-6716-4e28-bbea-9fc6f14c5d52 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:41.988590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:41.989599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:41.989962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:41.990371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] PATH_INFO: `/v3/users/dc8e42092f3146d085a58330532a8eb6` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:41.992074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8e42092f3146d085a58330532a8eb6)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:41.994401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:42.071469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8e42092f3146d085a58330532a8eb6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:42.092967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8e42092f3146d085a58330532a8eb6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:42.095373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8e42092f3146d085a58330532a8eb6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:42.096071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8e42092f3146d085a58330532a8eb6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:42.108303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-08cfedf3-fdd2-448b-a216-98bd22d53d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8e42092f3146d085a58330532a8eb6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:42.118581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6267-ae89-40c8-804f-cb3576a19842 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.118952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6267-ae89-40c8-804f-cb3576a19842 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.119245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb6267-ae89-40c8-804f-cb3576a19842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.139073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1008/2020] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:41 2022] DELETE /identity/v3/users/dc8e42092f3146d085a58330532a8eb6 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:42.143512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc12d0-1304-47fa-ba3c-09957c34d62e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.143800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc12d0-1304-47fa-ba3c-09957c34d62e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.144118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc12d0-1304-47fa-ba3c-09957c34d62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.176363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-61eb6267-ae89-40c8-804f-cb3576a19842 None None] MFA Rules not processed for user `8e0dd9b1866a4c9391f2ce8d45bb76ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:42.177817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-61eb6267-ae89-40c8-804f-cb3576a19842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:42.179406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-00fc12d0-1304-47fa-ba3c-09957c34d62e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:42.181066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-00fc12d0-1304-47fa-ba3c-09957c34d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:42.275322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1013/2021] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:42.278379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1009/2022] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:42.281115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb6267-ae89-40c8-804f-cb3576a19842 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:42.282718 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-61eb6267-ae89-40c8-804f-cb3576a19842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:42.292826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc12d0-1304-47fa-ba3c-09957c34d62e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:42.297155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-00fc12d0-1304-47fa-ba3c-09957c34d62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:42.304918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb6267-ae89-40c8-804f-cb3576a19842 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:42.312904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24302ee-d820-4e04-95a2-00e9a843865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:42.313572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24302ee-d820-4e04-95a2-00e9a843865b admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.314169 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24302ee-d820-4e04-95a2-00e9a843865b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.314169 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24302ee-d820-4e04-95a2-00e9a843865b admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.314770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24302ee-d820-4e04-95a2-00e9a843865b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:42.317116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24302ee-d820-4e04-95a2-00e9a843865b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:42.324580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:42.353226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1014/2023] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:42 2022] POST /identity/v3/projects => generated 371 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:42.380983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24302ee-d820-4e04-95a2-00e9a843865b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:42.383684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc12d0-1304-47fa-ba3c-09957c34d62e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:42.455214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:42.457271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fb76d-7318-4fef-a5b1-c094b72b85ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:42.458070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb76d-7318-4fef-a5b1-c094b72b85ca service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.458423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb76d-7318-4fef-a5b1-c094b72b85ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.458816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fb76d-7318-4fef-a5b1-c094b72b85ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.482728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24302ee-d820-4e04-95a2-00e9a843865b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:42.488590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac306f3-9079-4173-8e2c-58b8f5599734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:42.489219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac306f3-9079-4173-8e2c-58b8f5599734 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.489500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac306f3-9079-4173-8e2c-58b8f5599734 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.489773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac306f3-9079-4173-8e2c-58b8f5599734 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.490415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac306f3-9079-4173-8e2c-58b8f5599734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:42.492909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac306f3-9079-4173-8e2c-58b8f5599734 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:42.536387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1015/2024] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:42 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:42.539027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac306f3-9079-4173-8e2c-58b8f5599734 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:42.553798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fb76d-7318-4fef-a5b1-c094b72b85ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:42.554940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac306f3-9079-4173-8e2c-58b8f5599734 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:42.555238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fb76d-7318-4fef-a5b1-c094b72b85ca service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:42.562986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73f3ae-5252-45f2-8502-dc9f1d740052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:42.564423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73f3ae-5252-45f2-8502-dc9f1d740052 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.564894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73f3ae-5252-45f2-8502-dc9f1d740052 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.565325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73f3ae-5252-45f2-8502-dc9f1d740052 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.566329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73f3ae-5252-45f2-8502-dc9f1d740052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:42.568259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73f3ae-5252-45f2-8502-dc9f1d740052 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:42.569431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1010/2025] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:42.585134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1016/2026] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:42.586181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fb76d-7318-4fef-a5b1-c094b72b85ca service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:42.597033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fb76d-7318-4fef-a5b1-c094b72b85ca service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:42.602095 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02d20-3813-4893-9767-30acd6153ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:42.602831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02d20-3813-4893-9767-30acd6153ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.603183 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02d20-3813-4893-9767-30acd6153ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.603525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c02d20-3813-4893-9767-30acd6153ac7 admin admin] PATH_INFO: `/v3/projects/9fdd48837f544ad3b22686fb40e4327e/users/90fdca4d71664454940981943540c52b/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.621995 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02d20-3813-4893-9767-30acd6153ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdd48837f544ad3b22686fb40e4327e, user_id=90fdca4d71664454940981943540c52b, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:42.625176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c02d20-3813-4893-9767-30acd6153ac7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:42.640286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1011/2027] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:42 2022] PUT /identity/v3/projects/9fdd48837f544ad3b22686fb40e4327e/users/90fdca4d71664454940981943540c52b/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:42.644731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73f3ae-5252-45f2-8502-dc9f1d740052 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:42.658152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73f3ae-5252-45f2-8502-dc9f1d740052 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:42.751862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:42.753395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.754151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.756692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.758391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:42.760082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:42.772885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1017/2028] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:42.778063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02d20-3813-4893-9767-30acd6153ac7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:42.789520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c02d20-3813-4893-9767-30acd6153ac7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:42.795706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583f255-86f7-4a81-ac9d-438f724b366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:42.796401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583f255-86f7-4a81-ac9d-438f724b366f admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:42.796685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583f255-86f7-4a81-ac9d-438f724b366f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:42.796959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583f255-86f7-4a81-ac9d-438f724b366f admin admin] PATH_INFO: `/v3/projects/9fdd48837f544ad3b22686fb40e4327e/users/90fdca4d71664454940981943540c52b/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:42.798868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583f255-86f7-4a81-ac9d-438f724b366f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fdd48837f544ad3b22686fb40e4327e, user_id=90fdca4d71664454940981943540c52b, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:42.801537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583f255-86f7-4a81-ac9d-438f724b366f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:42.812634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1012/2029] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:42 2022] PUT /identity/v3/projects/9fdd48837f544ad3b22686fb40e4327e/users/90fdca4d71664454940981943540c52b/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:42.895489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:42.897527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:42.925461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fca1be-8376-4268-8689-dbe50523d44f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:42.999316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:43.000645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.002734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.003034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] PATH_INFO: `/v3/projects/4bfbe31ad8f440d5a07bc2248b22daa6` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.004391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bfbe31ad8f440d5a07bc2248b22daa6)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:43.006453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:43.073993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bfbe31ad8f440d5a07bc2248b22daa6', 'request_id': 'req-866260c8-c7fe-4b5a-8ee7-14234b845c0c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:43.093059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bfbe31ad8f440d5a07bc2248b22daa6', 'request_id': 'req-866260c8-c7fe-4b5a-8ee7-14234b845c0c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:43.096045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:43.103472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bfbe31ad8f440d5a07bc2248b22daa6', 'request_id': 'req-866260c8-c7fe-4b5a-8ee7-14234b845c0c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:43.118228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] The token cache is being invalidate because project 4bfbe31ad8f440d5a07bc2248b22daa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:43.118593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:43.119492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-866260c8-c7fe-4b5a-8ee7-14234b845c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:43.122150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1018/2030] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:42 2022] DELETE /identity/v3/projects/4bfbe31ad8f440d5a07bc2248b22daa6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:43.126965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4152-ac4a-4042-b5d7-81d26559e489 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.127538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4152-ac4a-4042-b5d7-81d26559e489 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.127630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a4152-ac4a-4042-b5d7-81d26559e489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.149511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c47a4152-ac4a-4042-b5d7-81d26559e489 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:43.150873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c47a4152-ac4a-4042-b5d7-81d26559e489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:43.238302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:43.263097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1013/2031] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:43.272215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f99b82-2f26-4f1b-8aa2-c8a735501c98 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.272584 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f99b82-2f26-4f1b-8aa2-c8a735501c98 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.272836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f99b82-2f26-4f1b-8aa2-c8a735501c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.316471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-78f99b82-2f26-4f1b-8aa2-c8a735501c98 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:43.317426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-78f99b82-2f26-4f1b-8aa2-c8a735501c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:43.334544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4152-ac4a-4042-b5d7-81d26559e489 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:43.342520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1019/2032] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:43.346986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a4152-ac4a-4042-b5d7-81d26559e489 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:43.357530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:43.358187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.358472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.358748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.364204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:43.365862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:43.368573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:43.408844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f99b82-2f26-4f1b-8aa2-c8a735501c98 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:43.420408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1014/2033] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:43.427939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f99b82-2f26-4f1b-8aa2-c8a735501c98 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:43.440647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3787456-21d4-4755-b72c-5994a881a0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:43.441854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3787456-21d4-4755-b72c-5994a881a0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.441854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3787456-21d4-4755-b72c-5994a881a0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.441854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3787456-21d4-4755-b72c-5994a881a0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.442449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3787456-21d4-4755-b72c-5994a881a0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:43.445024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3787456-21d4-4755-b72c-5994a881a0d7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:43.492967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:43.494348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1020/2034] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:43 2022] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:43.513822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573d8c-535c-4592-a6ab-520ded43f6b4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:43.646102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aeb96-977e-42cc-9da9-7beadb5286fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:43.646890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aeb96-977e-42cc-9da9-7beadb5286fa admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.647243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aeb96-977e-42cc-9da9-7beadb5286fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.647640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3aeb96-977e-42cc-9da9-7beadb5286fa admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.648389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aeb96-977e-42cc-9da9-7beadb5286fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:43.650478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3aeb96-977e-42cc-9da9-7beadb5286fa admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:43.685332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1015/2035] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:43 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:43.686879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3787456-21d4-4755-b72c-5994a881a0d7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:43.704385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3787456-21d4-4755-b72c-5994a881a0d7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:43.713924 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835c56c-21b2-4b7b-ad9c-892e1c4b2095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:43.714570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c56c-21b2-4b7b-ad9c-892e1c4b2095 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.714855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c56c-21b2-4b7b-ad9c-892e1c4b2095 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.715130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835c56c-21b2-4b7b-ad9c-892e1c4b2095 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.715791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835c56c-21b2-4b7b-ad9c-892e1c4b2095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:43.717500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835c56c-21b2-4b7b-ad9c-892e1c4b2095 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:43.743687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1021/2036] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:43.748709 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aeb96-977e-42cc-9da9-7beadb5286fa admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:43.770694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3aeb96-977e-42cc-9da9-7beadb5286fa admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:43.785556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600a5ce4-d7f9-471d-bbf9-808910785aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:43.786080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5ce4-d7f9-471d-bbf9-808910785aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.786367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5ce4-d7f9-471d-bbf9-808910785aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.786699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a5ce4-d7f9-471d-bbf9-808910785aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.787361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a5ce4-d7f9-471d-bbf9-808910785aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:43.789495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600a5ce4-d7f9-471d-bbf9-808910785aa2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:43.844079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1016/2037] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:43.848957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835c56c-21b2-4b7b-ad9c-892e1c4b2095 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:43.863626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835c56c-21b2-4b7b-ad9c-892e1c4b2095 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:43.884620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb828f-a8cd-4ea6-b462-f27cb8627d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:43.885850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb828f-a8cd-4ea6-b462-f27cb8627d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.886138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb828f-a8cd-4ea6-b462-f27cb8627d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.886418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb828f-a8cd-4ea6-b462-f27cb8627d6e admin admin] PATH_INFO: `/v3/projects/5f89bb05483a4c139ce88440e125f620/users/1db09048b3714b1bb1bb78fbdbbb3aee/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.888672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd2305-f1a2-4765-8716-0442080b903c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.888954 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd2305-f1a2-4765-8716-0442080b903c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.889228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd2305-f1a2-4765-8716-0442080b903c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:43.921548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb828f-a8cd-4ea6-b462-f27cb8627d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f89bb05483a4c139ce88440e125f620, user_id=1db09048b3714b1bb1bb78fbdbbb3aee, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:43.926425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb828f-a8cd-4ea6-b462-f27cb8627d6e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:43.933765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5acd2305-f1a2-4765-8716-0442080b903c None None] MFA Rules not processed for user `90fdca4d71664454940981943540c52b`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:43.935197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5acd2305-f1a2-4765-8716-0442080b903c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:43.962918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1022/2038] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:43 2022] PUT /identity/v3/projects/5f89bb05483a4c139ce88440e125f620/users/1db09048b3714b1bb1bb78fbdbbb3aee/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:43.975515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188877db-338d-4eaf-a98f-2995ccc1521c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:43.975759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188877db-338d-4eaf-a98f-2995ccc1521c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:43.976001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188877db-338d-4eaf-a98f-2995ccc1521c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.028606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-188877db-338d-4eaf-a98f-2995ccc1521c None None] MFA Rules not processed for user `1db09048b3714b1bb1bb78fbdbbb3aee`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:44.031839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-188877db-338d-4eaf-a98f-2995ccc1521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:44.058731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1017/2039] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:44.071116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb3a8-4804-4a1e-9fe8-13d03537bba6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.071406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb3a8-4804-4a1e-9fe8-13d03537bba6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.071679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214bb3a8-4804-4a1e-9fe8-13d03537bba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.108405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-214bb3a8-4804-4a1e-9fe8-13d03537bba6 None None] MFA Rules not processed for user `8e0dd9b1866a4c9391f2ce8d45bb76ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:44.109988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-214bb3a8-4804-4a1e-9fe8-13d03537bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:44.137060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1023/2040] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:44.141735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188877db-338d-4eaf-a98f-2995ccc1521c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:44.157951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:44.194349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1018/2041] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:44.202696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb3a8-4804-4a1e-9fe8-13d03537bba6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:44.204549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-214bb3a8-4804-4a1e-9fe8-13d03537bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:44.239829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188877db-338d-4eaf-a98f-2995ccc1521c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:44.255802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ffe39-1b69-4ca8-97de-97ef31f6ad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:44.256473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ffe39-1b69-4ca8-97de-97ef31f6ad05 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.256754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ffe39-1b69-4ca8-97de-97ef31f6ad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.257028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ffe39-1b69-4ca8-97de-97ef31f6ad05 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.257863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ffe39-1b69-4ca8-97de-97ef31f6ad05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:44.260085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ffe39-1b69-4ca8-97de-97ef31f6ad05 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:44.279472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:44.299044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1024/2042] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:44 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:44.302389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ffe39-1b69-4ca8-97de-97ef31f6ad05 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:44.316212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214bb3a8-4804-4a1e-9fe8-13d03537bba6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:44.442926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ffe39-1b69-4ca8-97de-97ef31f6ad05 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:44.452275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4c0e-5c1b-465d-b716-df4b860fabb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:44.453490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4c0e-5c1b-465d-b716-df4b860fabb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.453954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4c0e-5c1b-465d-b716-df4b860fabb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.454423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff4c0e-5c1b-465d-b716-df4b860fabb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.455502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff4c0e-5c1b-465d-b716-df4b860fabb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:44.458965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff4c0e-5c1b-465d-b716-df4b860fabb0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:44.481414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:44.481972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.482250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.482742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.490828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:44.504276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1025/2043] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:44 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:44.507402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4c0e-5c1b-465d-b716-df4b860fabb0 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:44.553773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff4c0e-5c1b-465d-b716-df4b860fabb0 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:44.592572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4634f-b4d0-42dc-8003-9c194031bae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:44.593308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4634f-b4d0-42dc-8003-9c194031bae5 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.593522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4634f-b4d0-42dc-8003-9c194031bae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.593803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4634f-b4d0-42dc-8003-9c194031bae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.594505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4634f-b4d0-42dc-8003-9c194031bae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:44.596120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4634f-b4d0-42dc-8003-9c194031bae5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:44.621713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1026/2044] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:44.625834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4634f-b4d0-42dc-8003-9c194031bae5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:44.642391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4634f-b4d0-42dc-8003-9c194031bae5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:44.647734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:44.648206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.648485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.648762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.649407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:44.652201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:44.665422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1027/2045] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:44.666095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:44.668317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:44.670445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:44.670748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:44.686857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1019/2046] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:44.688098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:44.693215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf518b11-c9be-4781-aafa-40bf4fb00653 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:44.700091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:44.700800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.701085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.701357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] PATH_INFO: `/v3/users/17435582b436469daa4fee5bd1066899` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.702466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b7521-ffb6-468c-a766-5d28db85811d service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:44.703327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17435582b436469daa4fee5bd1066899)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:44.706018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:44.713167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a4219-0871-4119-bb56-865032371758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:44.714299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a4219-0871-4119-bb56-865032371758 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.714657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a4219-0871-4119-bb56-865032371758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.715003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a4219-0871-4119-bb56-865032371758 admin admin] PATH_INFO: `/v3/projects/bea121af1e164c51af7a1fcd6c6d9d90/users/7c0a0414bb414546af714df67d8901b0/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.777210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a4219-0871-4119-bb56-865032371758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea121af1e164c51af7a1fcd6c6d9d90, user_id=7c0a0414bb414546af714df67d8901b0, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:44.785524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a4219-0871-4119-bb56-865032371758 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:44.790100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:44.808278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1020/2047] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:44 2022] PUT /identity/v3/projects/bea121af1e164c51af7a1fcd6c6d9d90/users/7c0a0414bb414546af714df67d8901b0/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:44.821914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d538-a910-4853-ad37-69e85ede7781 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.822303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d538-a910-4853-ad37-69e85ede7781 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.822719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11d538-a910-4853-ad37-69e85ede7781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.824928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17435582b436469daa4fee5bd1066899'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:44.825871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17435582b436469daa4fee5bd1066899'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:44.850874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17435582b436469daa4fee5bd1066899'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:44.874695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17435582b436469daa4fee5bd1066899'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:44.879557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ad11d538-a910-4853-ad37-69e85ede7781 None None] MFA Rules not processed for user `7c0a0414bb414546af714df67d8901b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:44.880809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ad11d538-a910-4853-ad37-69e85ede7781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:44.884417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ad9a8a4c-35ef-4770-8047-db94b8d67c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17435582b436469daa4fee5bd1066899'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:44.896085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1028/2048] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:44 2022] DELETE /identity/v3/users/17435582b436469daa4fee5bd1066899 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:44.903188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf9649-0b6c-4e7f-b9cb-312754c6667f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:44.903709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf9649-0b6c-4e7f-b9cb-312754c6667f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:44.904138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf9649-0b6c-4e7f-b9cb-312754c6667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:44.961255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-77bf9649-0b6c-4e7f-b9cb-312754c6667f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:44.962483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-77bf9649-0b6c-4e7f-b9cb-312754c6667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:45.011975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1021/2049] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:45.019324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11d538-a910-4853-ad37-69e85ede7781 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:45.022512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ad11d538-a910-4853-ad37-69e85ede7781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:45.048552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:45.096055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1029/2050] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:45.106234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf9649-0b6c-4e7f-b9cb-312754c6667f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:45.107881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-77bf9649-0b6c-4e7f-b9cb-312754c6667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:45.133844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11d538-a910-4853-ad37-69e85ede7781 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:45.140706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c732e-6220-4aa4-9cf0-b31ca97e1056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:45.141992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c732e-6220-4aa4-9cf0-b31ca97e1056 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:45.142297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c732e-6220-4aa4-9cf0-b31ca97e1056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:45.142575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c732e-6220-4aa4-9cf0-b31ca97e1056 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:45.143381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c732e-6220-4aa4-9cf0-b31ca97e1056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:45.145813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c732e-6220-4aa4-9cf0-b31ca97e1056 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:45.203443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1022/2051] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:45 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:45.207822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c732e-6220-4aa4-9cf0-b31ca97e1056 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:45.240287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf9649-0b6c-4e7f-b9cb-312754c6667f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:45.351870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b77644-5db2-43ce-8fc5-bfd02be3ef3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:45.352534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77644-5db2-43ce-8fc5-bfd02be3ef3c service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:45.352819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77644-5db2-43ce-8fc5-bfd02be3ef3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:45.353093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b77644-5db2-43ce-8fc5-bfd02be3ef3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:45.364807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c732e-6220-4aa4-9cf0-b31ca97e1056 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:45.372065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5458-c5ab-42a4-9cfd-1094834b56a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:45.372973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5458-c5ab-42a4-9cfd-1094834b56a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:45.373451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5458-c5ab-42a4-9cfd-1094834b56a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:45.373942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5458-c5ab-42a4-9cfd-1094834b56a3 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:45.374798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5458-c5ab-42a4-9cfd-1094834b56a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:45.377390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5458-c5ab-42a4-9cfd-1094834b56a3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:45.415872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:45.435228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1023/2052] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:45 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:45.436869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5458-c5ab-42a4-9cfd-1094834b56a3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:45.446447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b77644-5db2-43ce-8fc5-bfd02be3ef3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:45.449042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b77644-5db2-43ce-8fc5-bfd02be3ef3c service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:45.449255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5458-c5ab-42a4-9cfd-1094834b56a3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:45.458881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b607a5-b72a-4701-a509-05a61e36039a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:45.459746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b607a5-b72a-4701-a509-05a61e36039a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:45.460144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b607a5-b72a-4701-a509-05a61e36039a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:45.460926 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b607a5-b72a-4701-a509-05a61e36039a admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:45.461731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b607a5-b72a-4701-a509-05a61e36039a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:45.463756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1030/2053] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:45.464881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b607a5-b72a-4701-a509-05a61e36039a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:45.478286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1024/2054] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:45.482823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b77644-5db2-43ce-8fc5-bfd02be3ef3c service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:45.496438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b77644-5db2-43ce-8fc5-bfd02be3ef3c service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:45.503643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196ee23-00fe-4774-a8b2-e549da9b323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:45.504715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196ee23-00fe-4774-a8b2-e549da9b323d admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:45.505509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196ee23-00fe-4774-a8b2-e549da9b323d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:45.506126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196ee23-00fe-4774-a8b2-e549da9b323d admin admin] PATH_INFO: `/v3/projects/c9e0942028c94fbdb5841463dd06aff7/users/576a5459ccb646ab986b23a577255896/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:45.529524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196ee23-00fe-4774-a8b2-e549da9b323d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e0942028c94fbdb5841463dd06aff7, user_id=576a5459ccb646ab986b23a577255896, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:45.532296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196ee23-00fe-4774-a8b2-e549da9b323d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:45.562221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1031/2055] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:45 2022] PUT /identity/v3/projects/c9e0942028c94fbdb5841463dd06aff7/users/576a5459ccb646ab986b23a577255896/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:45.566260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b607a5-b72a-4701-a509-05a61e36039a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:45.581501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b607a5-b72a-4701-a509-05a61e36039a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:45.788026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8ae20-097d-47ab-a6ee-fefad96fc8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:45.788806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8ae20-097d-47ab-a6ee-fefad96fc8be admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:45.789138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8ae20-097d-47ab-a6ee-fefad96fc8be admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:45.789352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8ae20-097d-47ab-a6ee-fefad96fc8be admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:45.790077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8ae20-097d-47ab-a6ee-fefad96fc8be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:45.792544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8ae20-097d-47ab-a6ee-fefad96fc8be admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:45.810191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1025/2056] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:45.811403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196ee23-00fe-4774-a8b2-e549da9b323d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:45.826840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196ee23-00fe-4774-a8b2-e549da9b323d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:45.841588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:45.842372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:45.843002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:45.843291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] PATH_INFO: `/v3/projects/c9e0942028c94fbdb5841463dd06aff7/users/576a5459ccb646ab986b23a577255896/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:45.847744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9e0942028c94fbdb5841463dd06aff7, user_id=576a5459ccb646ab986b23a577255896, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:45.850846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:45.868838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1032/2057] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:45 2022] PUT /identity/v3/projects/c9e0942028c94fbdb5841463dd06aff7/users/576a5459ccb646ab986b23a577255896/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:45.879413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55d36-cc6d-4478-9959-7d36867ad271 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:45.879816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55d36-cc6d-4478-9959-7d36867ad271 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:45.880224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55d36-cc6d-4478-9959-7d36867ad271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:45.935282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-63a55d36-cc6d-4478-9959-7d36867ad271 None None] MFA Rules not processed for user `576a5459ccb646ab986b23a577255896`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:45.937179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-63a55d36-cc6d-4478-9959-7d36867ad271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:45.978656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:45.981652 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:45.991865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:46.110097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acb228-edfe-47ba-90bc-98b41a0eb281 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:46.114899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1026/2058] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:46.115976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:46.116913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.117192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.117475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] PATH_INFO: `/v3/projects/79ac59422fc842438365cabeb3a7f044` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.118821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79ac59422fc842438365cabeb3a7f044)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:46.122659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:46.132645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55d36-cc6d-4478-9959-7d36867ad271 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:46.134103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-63a55d36-cc6d-4478-9959-7d36867ad271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:46.201825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79ac59422fc842438365cabeb3a7f044', 'request_id': 'req-59c7e34c-ea30-4701-83b9-325809a47207'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:46.211306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79ac59422fc842438365cabeb3a7f044', 'request_id': 'req-59c7e34c-ea30-4701-83b9-325809a47207'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:46.220069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79ac59422fc842438365cabeb3a7f044', 'request_id': 'req-59c7e34c-ea30-4701-83b9-325809a47207'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:46.221364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55d36-cc6d-4478-9959-7d36867ad271 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:46.232195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] The token cache is being invalidate because project 79ac59422fc842438365cabeb3a7f044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:46.232491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:46.235762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-59c7e34c-ea30-4701-83b9-325809a47207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:46.241671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1033/2059] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:45 2022] DELETE /identity/v3/projects/79ac59422fc842438365cabeb3a7f044 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:46.246094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c1e7-eb23-4119-b3e9-9c9654b991a2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.246543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c1e7-eb23-4119-b3e9-9c9654b991a2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.246830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c1e7-eb23-4119-b3e9-9c9654b991a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.268881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:46.273600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4ac3c1e7-eb23-4119-b3e9-9c9654b991a2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:46.275094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4ac3c1e7-eb23-4119-b3e9-9c9654b991a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:46.321146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:46.324571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.325046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.325339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.328481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:46.355469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1034/2060] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:46.356963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189840-302f-4bc6-80eb-8c5b041f9fa5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.357257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189840-302f-4bc6-80eb-8c5b041f9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.357534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17189840-302f-4bc6-80eb-8c5b041f9fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.384851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-17189840-302f-4bc6-80eb-8c5b041f9fa5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:46.386860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-17189840-302f-4bc6-80eb-8c5b041f9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:46.399795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1035/2061] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:46.404423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17189840-302f-4bc6-80eb-8c5b041f9fa5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:46.424287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17189840-302f-4bc6-80eb-8c5b041f9fa5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:46.425520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:46.427347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:46.429454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:46.430165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.430542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.430913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.431798 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:46.432753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:46.434481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:46.439843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1027/2062] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:46.450450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1036/2063] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:46.454123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:46.465568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b461b-78e5-4e0d-a47e-02d3bdaa905b service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:46.471005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adce72-25c9-481f-8fc3-0bdf6457f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:46.471619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adce72-25c9-481f-8fc3-0bdf6457f352 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.471899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adce72-25c9-481f-8fc3-0bdf6457f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.472192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adce72-25c9-481f-8fc3-0bdf6457f352 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.472863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adce72-25c9-481f-8fc3-0bdf6457f352 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:46.475954 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adce72-25c9-481f-8fc3-0bdf6457f352 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:46.508355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1028/2064] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:46 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:46.511642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:46.524362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301514b2-a93b-48dd-b13a-5cfac7954c8f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:46.539635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:46.617931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b72f7-8c0a-4c34-b001-18cfb0d3757d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:46.618689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b72f7-8c0a-4c34-b001-18cfb0d3757d admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.619212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b72f7-8c0a-4c34-b001-18cfb0d3757d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.620430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b72f7-8c0a-4c34-b001-18cfb0d3757d admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.621564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b72f7-8c0a-4c34-b001-18cfb0d3757d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:46.623873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b72f7-8c0a-4c34-b001-18cfb0d3757d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:46.657807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1037/2065] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:46 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:46.659198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adce72-25c9-481f-8fc3-0bdf6457f352 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:46.686058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adce72-25c9-481f-8fc3-0bdf6457f352 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:46.692305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d932-4b7b-4a0f-a8dd-3c7b71b43e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:46.694069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d932-4b7b-4a0f-a8dd-3c7b71b43e33 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.694749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d932-4b7b-4a0f-a8dd-3c7b71b43e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.695179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624d932-4b7b-4a0f-a8dd-3c7b71b43e33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.696370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d932-4b7b-4a0f-a8dd-3c7b71b43e33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:46.698821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624d932-4b7b-4a0f-a8dd-3c7b71b43e33 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:46.720819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1029/2066] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:46.734468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b72f7-8c0a-4c34-b001-18cfb0d3757d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:46.752466 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b72f7-8c0a-4c34-b001-18cfb0d3757d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:46.758505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92fa59-c57c-43dd-b432-5121f233a685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:46.760118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92fa59-c57c-43dd-b432-5121f233a685 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.760534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92fa59-c57c-43dd-b432-5121f233a685 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.760908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92fa59-c57c-43dd-b432-5121f233a685 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.761659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92fa59-c57c-43dd-b432-5121f233a685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:46.763421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92fa59-c57c-43dd-b432-5121f233a685 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:46.790803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1038/2067] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:46.792881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d932-4b7b-4a0f-a8dd-3c7b71b43e33 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:46.815240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624d932-4b7b-4a0f-a8dd-3c7b71b43e33 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:46.821598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:46.822340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.822728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.823187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] PATH_INFO: `/v3/projects/9a75b477e03c4304a15cae3b0a346f42/users/afb9ed91ec6e4e4aac843514e85d5c38/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.849588 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a75b477e03c4304a15cae3b0a346f42, user_id=afb9ed91ec6e4e4aac843514e85d5c38, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:46.852733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:46.876017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1030/2068] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:46 2022] PUT /identity/v3/projects/9a75b477e03c4304a15cae3b0a346f42/users/afb9ed91ec6e4e4aac843514e85d5c38/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:46.887575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb5f81-76fe-43a7-8e94-9e66fe3c6e5b None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:46.888042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb5f81-76fe-43a7-8e94-9e66fe3c6e5b None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:46.888634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb5f81-76fe-43a7-8e94-9e66fe3c6e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:46.931222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-42eb5f81-76fe-43a7-8e94-9e66fe3c6e5b None None] MFA Rules not processed for user `afb9ed91ec6e4e4aac843514e85d5c38`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:46.933072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-42eb5f81-76fe-43a7-8e94-9e66fe3c6e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:46.935541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:46.937681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:47.032200 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1cd8c-13b5-473a-a179-8cd828f8b200 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:47.038373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:47.039253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:47.039648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:47.040398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] PATH_INFO: `/v3/users/fd3f0d8c312546e5885103f373a630c6` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:47.043136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd3f0d8c312546e5885103f373a630c6)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:47.045699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:47.048035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1039/2069] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:47.057152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb5f81-76fe-43a7-8e94-9e66fe3c6e5b None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:47.060360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-42eb5f81-76fe-43a7-8e94-9e66fe3c6e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:47.076032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:47.135756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd3f0d8c312546e5885103f373a630c6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.151367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd3f0d8c312546e5885103f373a630c6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.152129 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd3f0d8c312546e5885103f373a630c6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.152785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd3f0d8c312546e5885103f373a630c6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.153213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb5f81-76fe-43a7-8e94-9e66fe3c6e5b None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:47.157102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:47.157992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:47.158422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:47.158785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:47.160858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:47.161654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d367f158-cdbc-4ccc-8627-987312f8b5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd3f0d8c312546e5885103f373a630c6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.175132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:47.178816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1031/2070] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:46 2022] DELETE /identity/v3/users/fd3f0d8c312546e5885103f373a630c6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:47.179064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:47.184419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef945f-dc35-44f3-8bae-c1da588dfa2e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:47.185213 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef945f-dc35-44f3-8bae-c1da588dfa2e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:47.185836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef945f-dc35-44f3-8bae-c1da588dfa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:47.189928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1040/2071] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:47.213574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-15ef945f-dc35-44f3-8bae-c1da588dfa2e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:47.215561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-15ef945f-dc35-44f3-8bae-c1da588dfa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:47.326954 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1032/2072] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:47.338363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:47.339609 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:47.391657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:47.438964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab79ef-0fcd-472b-aceb-0351c8a64ce7 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:47.518263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e423e-44f0-442a-bc57-75e72ada3b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:47.519263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e423e-44f0-442a-bc57-75e72ada3b76 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:47.519733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e423e-44f0-442a-bc57-75e72ada3b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:47.520342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e423e-44f0-442a-bc57-75e72ada3b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:47.532881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e423e-44f0-442a-bc57-75e72ada3b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:47.534634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e423e-44f0-442a-bc57-75e72ada3b76 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:47.549065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1041/2073] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:47.627348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef945f-dc35-44f3-8bae-c1da588dfa2e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:47.629053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-15ef945f-dc35-44f3-8bae-c1da588dfa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:47.646397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef945f-dc35-44f3-8bae-c1da588dfa2e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:47.678837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:47.679936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:47.680880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:47.681327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] PATH_INFO: `/v3/users/e53c0e506be04991ba68a7828324dd36` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:47.686737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53c0e506be04991ba68a7828324dd36)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:47.701938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:47.781176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53c0e506be04991ba68a7828324dd36'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.800425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53c0e506be04991ba68a7828324dd36'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.801169 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53c0e506be04991ba68a7828324dd36'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.802004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53c0e506be04991ba68a7828324dd36'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.811146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53c0e506be04991ba68a7828324dd36'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:47.828987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1033/2074] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:47 2022] DELETE /identity/v3/users/e53c0e506be04991ba68a7828324dd36 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:47.833515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba21fc-9bb7-46f8-8616-ddc80ff456e1 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:47.834071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba21fc-9bb7-46f8-8616-ddc80ff456e1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:47.834500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba21fc-9bb7-46f8-8616-ddc80ff456e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:47.872376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-79ba21fc-9bb7-46f8-8616-ddc80ff456e1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:47.874085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-79ba21fc-9bb7-46f8-8616-ddc80ff456e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:47.974970 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1042/2075] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:48.090191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:48.091933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:48.136240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:48.185419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba21fc-9bb7-46f8-8616-ddc80ff456e1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:48.187139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-79ba21fc-9bb7-46f8-8616-ddc80ff456e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:48.207719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba21fc-9bb7-46f8-8616-ddc80ff456e1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:48.230907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:48.231741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:48.232033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:48.232348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] PATH_INFO: `/v3/projects/207d0e3c2a4749fe8fc6efda65af4441` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:48.233239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2aa5b-6e5e-4fba-9c76-1a841307b378 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:48.235159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=207d0e3c2a4749fe8fc6efda65af4441)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:48.237669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:48.245272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:48.246045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:48.246329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:48.246603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:48.266409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:48.268854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:48.294840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1034/2076] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:48.297543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:48.299291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:48.345262 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '207d0e3c2a4749fe8fc6efda65af4441', 'request_id': 'req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.364287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '207d0e3c2a4749fe8fc6efda65af4441', 'request_id': 'req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.380970 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '207d0e3c2a4749fe8fc6efda65af4441', 'request_id': 'req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.400274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] The token cache is being invalidate because project 207d0e3c2a4749fe8fc6efda65af4441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:48.400274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.402286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.405107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1043/2077] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:48 2022] DELETE /identity/v3/projects/207d0e3c2a4749fe8fc6efda65af4441 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:48.409509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:48.411344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:48.426717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:48.477333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4284805-6601-49a3-99d4-70bca4b7b010 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:48.554806 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc3f91-b4c9-470e-9ac1-e3b30f0bac55 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:48.566578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:48.567197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:48.567487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:48.567765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] PATH_INFO: `/v3/users/1b3fbde71bee4b3da7068cc60be2285c` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:48.569902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b3fbde71bee4b3da7068cc60be2285c)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:48.572219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:48.604502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:48.605531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:48.605727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:48.606060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:48.608715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:48.674967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b3fbde71bee4b3da7068cc60be2285c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.676124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b3fbde71bee4b3da7068cc60be2285c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.685510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b3fbde71bee4b3da7068cc60be2285c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.705600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b3fbde71bee4b3da7068cc60be2285c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.717630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b3fbde71bee4b3da7068cc60be2285c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:48.726161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1044/2078] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:48 2022] DELETE /identity/v3/users/1b3fbde71bee4b3da7068cc60be2285c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:48.766919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:48.768755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:48.787667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1035/2079] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:49.691648 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:49.693539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:49.894659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:49.899010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e7f00-c937-43c5-9a31-81b355d7d5d4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:49.905708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:49.906401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:49.913332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:49.913726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] PATH_INFO: `/v3/projects/a449a7e81a4a4c27b9f322b37365f823` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:49.915514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=a449a7e81a4a4c27b9f322b37365f823)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:49.918354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:49.925082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144c19-dba9-492e-9707-d847f92be6cb service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:49.941275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:49.941929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:49.942212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:49.942490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] PATH_INFO: `/v3/projects/a9695ef3cafe490abb781c94a683a959` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:49.943862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9695ef3cafe490abb781c94a683a959)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:49.945891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:50.038362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:50.062308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:50.099004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9695ef3cafe490abb781c94a683a959', 'request_id': 'req-4182cf28-9468-46f9-ae74-cc3668c0bef5'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.114768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a449a7e81a4a4c27b9f322b37365f823', 'request_id': 'req-2f71565d-0742-4f8a-ba79-6db5caf102ca'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.133076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9695ef3cafe490abb781c94a683a959', 'request_id': 'req-4182cf28-9468-46f9-ae74-cc3668c0bef5'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.141785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a449a7e81a4a4c27b9f322b37365f823', 'request_id': 'req-2f71565d-0742-4f8a-ba79-6db5caf102ca'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.142108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9695ef3cafe490abb781c94a683a959', 'request_id': 'req-4182cf28-9468-46f9-ae74-cc3668c0bef5'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.154506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a449a7e81a4a4c27b9f322b37365f823', 'request_id': 'req-2f71565d-0742-4f8a-ba79-6db5caf102ca'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.169149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] The token cache is being invalidate because project a9695ef3cafe490abb781c94a683a959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:50.169788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.170406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.176027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1036/2080] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:49 2022] DELETE /identity/v3/projects/a9695ef3cafe490abb781c94a683a959 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:50.176027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:50.176333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] The token cache is being invalidate because project a449a7e81a4a4c27b9f322b37365f823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:50.177011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.177820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2f71565d-0742-4f8a-ba79-6db5caf102ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.186948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1045/2081] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:49 2022] DELETE /identity/v3/projects/a449a7e81a4a4c27b9f322b37365f823 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:50.187267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:50.188597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e022-460e-475b-80c1-e5c96e811dff None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:50.188994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e022-460e-475b-80c1-e5c96e811dff None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:50.189343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3e022-460e-475b-80c1-e5c96e811dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:50.274594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8ab3e022-460e-475b-80c1-e5c96e811dff None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:50.276939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8ab3e022-460e-475b-80c1-e5c96e811dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:50.303364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182cf28-9468-46f9-ae74-cc3668c0bef5 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:50.310752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c5950-b043-4134-bbda-7cec593cf9b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:50.311384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c5950-b043-4134-bbda-7cec593cf9b1 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:50.311662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c5950-b043-4134-bbda-7cec593cf9b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:50.311933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c5950-b043-4134-bbda-7cec593cf9b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:50.314472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5e8c5950-b043-4134-bbda-7cec593cf9b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:50.451889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1046/2082] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:50.452718 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3e022-460e-475b-80c1-e5c96e811dff None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:50.458882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8ab3e022-460e-475b-80c1-e5c96e811dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:50.460930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c5950-b043-4134-bbda-7cec593cf9b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:50.462421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c5950-b043-4134-bbda-7cec593cf9b1 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:50.475420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1037/2083] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:50.476986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53802858-3438-41ce-bc68-310866bd974e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:50.477272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53802858-3438-41ce-bc68-310866bd974e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:50.477551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53802858-3438-41ce-bc68-310866bd974e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:50.501090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3e022-460e-475b-80c1-e5c96e811dff None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:50.517139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:50.517891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:50.518244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:50.518521 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] PATH_INFO: `/v3/users/30156492d0e74fccac75910abda93fd3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:50.520921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30156492d0e74fccac75910abda93fd3)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:50.528747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:50.544335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-53802858-3438-41ce-bc68-310866bd974e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:50.546053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-53802858-3438-41ce-bc68-310866bd974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:50.556569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1038/2084] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:50.561428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53802858-3438-41ce-bc68-310866bd974e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:50.574271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53802858-3438-41ce-bc68-310866bd974e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:50.584029 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:50.584877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:50.585170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:50.586063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:50.586890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:50.587211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:50.590301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:50.605631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1039/2085] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:50.611971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:50.621430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30156492d0e74fccac75910abda93fd3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.622686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30156492d0e74fccac75910abda93fd3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.626114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4158840-9659-4ebc-81a8-feac0a06b3b8 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:50.633547 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b107b-7607-423d-858b-9851a9c0a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:50.634442 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b107b-7607-423d-858b-9851a9c0a9bb admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:50.634779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b107b-7607-423d-858b-9851a9c0a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:50.636385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b107b-7607-423d-858b-9851a9c0a9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:50.637069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b107b-7607-423d-858b-9851a9c0a9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:50.637436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30156492d0e74fccac75910abda93fd3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.642733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b107b-7607-423d-858b-9851a9c0a9bb admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:50.661492 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30156492d0e74fccac75910abda93fd3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.677725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30156492d0e74fccac75910abda93fd3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:50.688619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1047/2086] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:50 2022] DELETE /identity/v3/users/30156492d0e74fccac75910abda93fd3 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:50.702951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1040/2087] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:50 2022] POST /identity/v3/projects => generated 363 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:50.707658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:50.709485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:50.799872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:50.844235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc1781-b287-43ec-acea-6693a97ab195 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:50.940471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7c21e-f1f7-4e80-9b91-d6ae6b65b1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:50.941303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7c21e-f1f7-4e80-9b91-d6ae6b65b1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:50.941861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7c21e-f1f7-4e80-9b91-d6ae6b65b1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:50.942324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e7c21e-f1f7-4e80-9b91-d6ae6b65b1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:50.943927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7c21e-f1f7-4e80-9b91-d6ae6b65b1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:50.946392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e7c21e-f1f7-4e80-9b91-d6ae6b65b1c7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:50.983435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1048/2088] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:50 2022] POST /identity/v3/users => generated 282 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:50.992423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b107b-7607-423d-858b-9851a9c0a9bb admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.008126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b107b-7607-423d-858b-9851a9c0a9bb admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.014914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149bc4-3609-4515-9858-4a5811c49ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.015919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149bc4-3609-4515-9858-4a5811c49ecf admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.016414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149bc4-3609-4515-9858-4a5811c49ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.016984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef149bc4-3609-4515-9858-4a5811c49ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.017823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef149bc4-3609-4515-9858-4a5811c49ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.019673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef149bc4-3609-4515-9858-4a5811c49ecf admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.032782 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1041/2089] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:51.036655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7c21e-f1f7-4e80-9b91-d6ae6b65b1c7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.050545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e7c21e-f1f7-4e80-9b91-d6ae6b65b1c7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.057526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.058481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.058858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.059160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.059951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.064579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.078158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1049/2090] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:51.079643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149bc4-3609-4515-9858-4a5811c49ecf admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.092662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef149bc4-3609-4515-9858-4a5811c49ecf admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.099195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222312a-284a-4809-a598-5e93aba8ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.100139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222312a-284a-4809-a598-5e93aba8ef0f admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.101307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222312a-284a-4809-a598-5e93aba8ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.101690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222312a-284a-4809-a598-5e93aba8ef0f admin admin] PATH_INFO: `/v3/projects/9375a9cdd95544d3b40f5ad82d9e9f48/users/6cf5032d5c5c46bf80df61830c9eb113/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.104957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:51.118167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.120783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:51.137264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222312a-284a-4809-a598-5e93aba8ef0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9375a9cdd95544d3b40f5ad82d9e9f48, user_id=6cf5032d5c5c46bf80df61830c9eb113, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.141173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222312a-284a-4809-a598-5e93aba8ef0f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.154775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3a354-a027-453a-a1d5-be6efed3ea8f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.165790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.166833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.167300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.167654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] PATH_INFO: `/v3/projects/c05e0bb70cd04f79914df54a410649f9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.170998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05e0bb70cd04f79914df54a410649f9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.173376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.174984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1042/2091] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:51 2022] PUT /identity/v3/projects/9375a9cdd95544d3b40f5ad82d9e9f48/users/6cf5032d5c5c46bf80df61830c9eb113/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:51.188683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529c2c-27ba-40ca-b382-40f8accca4eb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.190027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529c2c-27ba-40ca-b382-40f8accca4eb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.190334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c529c2c-27ba-40ca-b382-40f8accca4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.230971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8c529c2c-27ba-40ca-b382-40f8accca4eb None None] MFA Rules not processed for user `6cf5032d5c5c46bf80df61830c9eb113`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:51.232249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8c529c2c-27ba-40ca-b382-40f8accca4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:51.249884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05e0bb70cd04f79914df54a410649f9', 'request_id': 'req-5571e392-605d-41f6-9723-f564bf205eb3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:51.258605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05e0bb70cd04f79914df54a410649f9', 'request_id': 'req-5571e392-605d-41f6-9723-f564bf205eb3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:51.265922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05e0bb70cd04f79914df54a410649f9', 'request_id': 'req-5571e392-605d-41f6-9723-f564bf205eb3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:51.278724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] The token cache is being invalidate because project c05e0bb70cd04f79914df54a410649f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:51.279012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:51.279690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5571e392-605d-41f6-9723-f564bf205eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:51.281589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1050/2092] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:51 2022] DELETE /identity/v3/projects/c05e0bb70cd04f79914df54a410649f9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:51.289716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfc154-7273-4d5b-b3ad-888d788d8636 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.290078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfc154-7273-4d5b-b3ad-888d788d8636 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.290417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfc154-7273-4d5b-b3ad-888d788d8636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.312516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-11dfc154-7273-4d5b-b3ad-888d788d8636 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:51.313842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1043/2093] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:51.314553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-11dfc154-7273-4d5b-b3ad-888d788d8636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:51.318263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c529c2c-27ba-40ca-b382-40f8accca4eb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.319574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8c529c2c-27ba-40ca-b382-40f8accca4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:51.357653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:51.391054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1051/2094] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:51.397092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c529c2c-27ba-40ca-b382-40f8accca4eb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.398616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f59433-b28a-4b2b-a09b-18d70ed13314 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.398915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f59433-b28a-4b2b-a09b-18d70ed13314 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.399238 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f59433-b28a-4b2b-a09b-18d70ed13314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.403191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e68c89-5536-4d2c-b49b-7eaeedd5eaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.403928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68c89-5536-4d2c-b49b-7eaeedd5eaab admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.404320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68c89-5536-4d2c-b49b-7eaeedd5eaab admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.404659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e68c89-5536-4d2c-b49b-7eaeedd5eaab admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.405376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e68c89-5536-4d2c-b49b-7eaeedd5eaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.407790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e68c89-5536-4d2c-b49b-7eaeedd5eaab admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.428258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-96f59433-b28a-4b2b-a09b-18d70ed13314 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:51.429496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-96f59433-b28a-4b2b-a09b-18d70ed13314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:51.439725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1052/2095] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:51.443879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f59433-b28a-4b2b-a09b-18d70ed13314 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.444640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1044/2096] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:51 2022] POST /identity/v3/projects => generated 363 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:51.449236 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e68c89-5536-4d2c-b49b-7eaeedd5eaab admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.453831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f59433-b28a-4b2b-a09b-18d70ed13314 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.523831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:51.532390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.533005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e68c89-5536-4d2c-b49b-7eaeedd5eaab admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.533244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.533709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.534256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.535126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:51.535578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.537605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.539573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091b36-75a2-4bb9-9b45-6a9abb3953c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.540285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091b36-75a2-4bb9-9b45-6a9abb3953c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.542100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091b36-75a2-4bb9-9b45-6a9abb3953c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.542530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091b36-75a2-4bb9-9b45-6a9abb3953c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.543252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091b36-75a2-4bb9-9b45-6a9abb3953c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.546362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091b36-75a2-4bb9-9b45-6a9abb3953c3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.555404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1053/2097] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:46:51.562158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.577742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612dfca-ab85-4e4b-ac16-db333bb97f9c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.580524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1045/2098] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:51 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:51.583999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091b36-75a2-4bb9-9b45-6a9abb3953c3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.590173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d3bf9-95f7-45ac-9b31-843911339005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.591122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d3bf9-95f7-45ac-9b31-843911339005 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.591531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d3bf9-95f7-45ac-9b31-843911339005 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.592130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d3bf9-95f7-45ac-9b31-843911339005 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.592908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d3bf9-95f7-45ac-9b31-843911339005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.596287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d3bf9-95f7-45ac-9b31-843911339005 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.610081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091b36-75a2-4bb9-9b45-6a9abb3953c3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.616198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd4eff-5a81-4918-97be-c9282e59b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.617972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4eff-5a81-4918-97be-c9282e59b26d admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.618418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4eff-5a81-4918-97be-c9282e59b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.618846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd4eff-5a81-4918-97be-c9282e59b26d admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.620264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd4eff-5a81-4918-97be-c9282e59b26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.622034 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcd4eff-5a81-4918-97be-c9282e59b26d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.644224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1046/2099] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:51.651181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd4eff-5a81-4918-97be-c9282e59b26d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.654599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1054/2100] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:51 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:51.661618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d3bf9-95f7-45ac-9b31-843911339005 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.664227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd4eff-5a81-4918-97be-c9282e59b26d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.764116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d3bf9-95f7-45ac-9b31-843911339005 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.779303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.780142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.782754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.783346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.783979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.788601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.836594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81497977-ced6-413d-97a5-b79b503f4357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.837347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81497977-ced6-413d-97a5-b79b503f4357 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.837546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81497977-ced6-413d-97a5-b79b503f4357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.837842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81497977-ced6-413d-97a5-b79b503f4357 admin admin] PATH_INFO: `/v3/projects/ef5fa1269bdd454e89c1ac3d2d5f09b2/users/521f4bcf26a146b9a36474dab70212ad/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.848762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1055/2101] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:51 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:51.849342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.854102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:51.866182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81497977-ced6-413d-97a5-b79b503f4357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5fa1269bdd454e89c1ac3d2d5f09b2, user_id=521f4bcf26a146b9a36474dab70212ad, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.868891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81497977-ced6-413d-97a5-b79b503f4357 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.872876 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fa173-4af9-41d6-81c1-937a87a45f47 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:51.881847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:51.883021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:51.883401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:51.883931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] PATH_INFO: `/v3/users/afb9ed91ec6e4e4aac843514e85d5c38` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:51.886237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb9ed91ec6e4e4aac843514e85d5c38)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:51.888813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:51.896560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1047/2102] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:51 2022] PUT /identity/v3/projects/ef5fa1269bdd454e89c1ac3d2d5f09b2/users/521f4bcf26a146b9a36474dab70212ad/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:51.897842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81497977-ced6-413d-97a5-b79b503f4357 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:51.947137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:51.971954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb9ed91ec6e4e4aac843514e85d5c38'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:51.973181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb9ed91ec6e4e4aac843514e85d5c38'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:51.987607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb9ed91ec6e4e4aac843514e85d5c38'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:52.018725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81497977-ced6-413d-97a5-b79b503f4357 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.023816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.024503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.024788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.025058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.026591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.028591 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.037521 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb9ed91ec6e4e4aac843514e85d5c38'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:52.041209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1048/2103] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:51 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:52.042654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.047085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:52.058504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb9ed91ec6e4e4aac843514e85d5c38'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:52.061506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28118c68-c542-4fe7-b1bc-9d2cd4f8cd7e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.067041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8125748-1795-47a6-a27d-40c7098d7dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.067751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125748-1795-47a6-a27d-40c7098d7dac admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.068294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125748-1795-47a6-a27d-40c7098d7dac admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.068618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8125748-1795-47a6-a27d-40c7098d7dac admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.069334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8125748-1795-47a6-a27d-40c7098d7dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.071718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8125748-1795-47a6-a27d-40c7098d7dac admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.076462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1056/2104] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:51 2022] DELETE /identity/v3/users/afb9ed91ec6e4e4aac843514e85d5c38 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:52.079866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.085901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:52.088760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1049/2105] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:52.091927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1dfef-8948-440f-a007-2ca7d69e82d0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.105224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1dfef-8948-440f-a007-2ca7d69e82d0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.105224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1dfef-8948-440f-a007-2ca7d69e82d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.116380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-51c1dfef-8948-440f-a007-2ca7d69e82d0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:52.117721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-51c1dfef-8948-440f-a007-2ca7d69e82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:52.208796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:52.239809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec02a-b2a3-4321-8cca-8d8acb93d3c9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.250051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1050/2106] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:52.256864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1dfef-8948-440f-a007-2ca7d69e82d0 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.264694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.265814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.266227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.266832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.267643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.269430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.286039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1dfef-8948-440f-a007-2ca7d69e82d0 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.289370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1057/2107] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:52.290828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.293257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e08e-0bb9-4ca3-9f51-711b5f197aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.294161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e08e-0bb9-4ca3-9f51-711b5f197aa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.294759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e08e-0bb9-4ca3-9f51-711b5f197aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.295100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569e08e-0bb9-4ca3-9f51-711b5f197aa4 admin admin] PATH_INFO: `/v3/projects/ef5fa1269bdd454e89c1ac3d2d5f09b2/users/521f4bcf26a146b9a36474dab70212ad/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.297370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569e08e-0bb9-4ca3-9f51-711b5f197aa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef5fa1269bdd454e89c1ac3d2d5f09b2, user_id=521f4bcf26a146b9a36474dab70212ad, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.300233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9569e08e-0bb9-4ca3-9f51-711b5f197aa4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.300420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:52.316652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1051/2108] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:52 2022] PUT /identity/v3/projects/ef5fa1269bdd454e89c1ac3d2d5f09b2/users/521f4bcf26a146b9a36474dab70212ad/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:52.317863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e08e-0bb9-4ca3-9f51-711b5f197aa4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.407578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a27f0-a1ff-493d-b6c7-08ba9d093005 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.421206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569e08e-0bb9-4ca3-9f51-711b5f197aa4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.430852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a9d43-5755-43b5-8318-c0bfa71f6a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.433040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9d43-5755-43b5-8318-c0bfa71f6a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.433040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9d43-5755-43b5-8318-c0bfa71f6a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.433285 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a9d43-5755-43b5-8318-c0bfa71f6a0d admin admin] PATH_INFO: `/v3/projects/4232e6de85ab4ad488643006325f616d/users/f721e94fd1c6472c8eb6da7bddbd0869/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.456746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a9d43-5755-43b5-8318-c0bfa71f6a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4232e6de85ab4ad488643006325f616d, user_id=f721e94fd1c6472c8eb6da7bddbd0869, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.461585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804a9d43-5755-43b5-8318-c0bfa71f6a0d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.471061 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6240135-973b-4a9c-9a2d-19f522b347c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.471744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6240135-973b-4a9c-9a2d-19f522b347c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.472027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6240135-973b-4a9c-9a2d-19f522b347c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.472334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6240135-973b-4a9c-9a2d-19f522b347c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.486311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6240135-973b-4a9c-9a2d-19f522b347c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.487772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6240135-973b-4a9c-9a2d-19f522b347c4 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.500307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1052/2109] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:52 2022] PUT /identity/v3/projects/4232e6de85ab4ad488643006325f616d/users/f721e94fd1c6472c8eb6da7bddbd0869/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:52.500307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70dc6c-2f09-45f9-b491-3557c6ae3508 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.500307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70dc6c-2f09-45f9-b491-3557c6ae3508 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.500307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b70dc6c-2f09-45f9-b491-3557c6ae3508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.502435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1058/2110] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:52.504080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f82cb-3e57-4498-af1c-85dfaab11ee4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.504454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f82cb-3e57-4498-af1c-85dfaab11ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.504795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f82cb-3e57-4498-af1c-85dfaab11ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.521240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:52.538494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4b70dc6c-2f09-45f9-b491-3557c6ae3508 None None] MFA Rules not processed for user `521f4bcf26a146b9a36474dab70212ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:52.540413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4b70dc6c-2f09-45f9-b491-3557c6ae3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:52.553286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9a3f82cb-3e57-4498-af1c-85dfaab11ee4 None None] MFA Rules not processed for user `f721e94fd1c6472c8eb6da7bddbd0869`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:52.554489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9a3f82cb-3e57-4498-af1c-85dfaab11ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:52.637878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1053/2111] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:52.648031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1059/2112] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:52.650601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70dc6c-2f09-45f9-b491-3557c6ae3508 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.652266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4b70dc6c-2f09-45f9-b491-3557c6ae3508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:52.652377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f82cb-3e57-4498-af1c-85dfaab11ee4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.720312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:52.736319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f82cb-3e57-4498-af1c-85dfaab11ee4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.742239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.742960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.743075 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b70dc6c-2f09-45f9-b491-3557c6ae3508 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.743245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.743647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.745059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.747579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.748027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e80b3-28c8-4bab-b85c-a8690a71a6ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.748839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e80b3-28c8-4bab-b85c-a8690a71a6ce service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.749278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e80b3-28c8-4bab-b85c-a8690a71a6ce service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.749551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e80b3-28c8-4bab-b85c-a8690a71a6ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.764942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e80b3-28c8-4bab-b85c-a8690a71a6ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.766627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e80b3-28c8-4bab-b85c-a8690a71a6ce service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.780331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1054/2113] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:52.781141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1060/2114] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:52 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:52.784853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e80b3-28c8-4bab-b85c-a8690a71a6ce service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.799663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e80b3-28c8-4bab-b85c-a8690a71a6ce service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.844339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.846647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:52.909623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1766104-9e2d-4b30-8559-037b3ee13c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.910453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1766104-9e2d-4b30-8559-037b3ee13c54 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.910774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1766104-9e2d-4b30-8559-037b3ee13c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.911007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1766104-9e2d-4b30-8559-037b3ee13c54 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.911707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1766104-9e2d-4b30-8559-037b3ee13c54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.913923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1766104-9e2d-4b30-8559-037b3ee13c54 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.942352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1055/2115] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:52 2022] POST /identity/v3/users => generated 300 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:52.943578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1766104-9e2d-4b30-8559-037b3ee13c54 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:52.953146 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed951f5-7318-4ad1-8f6f-fefb40ec421b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:52.958574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:52.959341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:52.959654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:52.959931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] PATH_INFO: `/v3/projects/9a75b477e03c4304a15cae3b0a346f42` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:52.961125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a75b477e03c4304a15cae3b0a346f42)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:52.963606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:52.996672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:53.007496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1766104-9e2d-4b30-8559-037b3ee13c54 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.011719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098c66f-c17e-4b9e-a3b1-4c6a907a4150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.012356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c66f-c17e-4b9e-a3b1-4c6a907a4150 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.012634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c66f-c17e-4b9e-a3b1-4c6a907a4150 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.012905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098c66f-c17e-4b9e-a3b1-4c6a907a4150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.014668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0098c66f-c17e-4b9e-a3b1-4c6a907a4150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:53.027186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a75b477e03c4304a15cae3b0a346f42', 'request_id': 'req-75474120-2deb-4841-a765-e0a6f40a3839'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.035530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a75b477e03c4304a15cae3b0a346f42', 'request_id': 'req-75474120-2deb-4841-a765-e0a6f40a3839'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.043996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a75b477e03c4304a15cae3b0a346f42', 'request_id': 'req-75474120-2deb-4841-a765-e0a6f40a3839'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.055598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] The token cache is being invalidate because project 9a75b477e03c4304a15cae3b0a346f42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:53.055890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.056672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.058241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1061/2116] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:52 2022] DELETE /identity/v3/projects/9a75b477e03c4304a15cae3b0a346f42 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:53.059360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.060899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:53.080989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098c66f-c17e-4b9e-a3b1-4c6a907a4150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.082434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098c66f-c17e-4b9e-a3b1-4c6a907a4150 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.092306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1056/2117] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:53.093534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca60e66-2d0c-418d-b45c-52eafefb02f7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.093854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca60e66-2d0c-418d-b45c-52eafefb02f7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.094194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca60e66-2d0c-418d-b45c-52eafefb02f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.115277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5ca60e66-2d0c-418d-b45c-52eafefb02f7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:53.116993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5ca60e66-2d0c-418d-b45c-52eafefb02f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:53.126727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1057/2118] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:53.129089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75474120-2deb-4841-a765-e0a6f40a3839 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.133987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d186b5a-b46b-400c-9816-1544a1d93d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.134128 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3c4e-4ee3-4b31-a291-16bcf786b176 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.134537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3c4e-4ee3-4b31-a291-16bcf786b176 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.134772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186b5a-b46b-400c-9816-1544a1d93d56 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.135434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c3c4e-4ee3-4b31-a291-16bcf786b176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.135561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186b5a-b46b-400c-9816-1544a1d93d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.135829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d186b5a-b46b-400c-9816-1544a1d93d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.136516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d186b5a-b46b-400c-9816-1544a1d93d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.139116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d186b5a-b46b-400c-9816-1544a1d93d56 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.151885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1062/2119] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:53.156204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d186b5a-b46b-400c-9816-1544a1d93d56 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.159643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9d4c3c4e-4ee3-4b31-a291-16bcf786b176 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:53.160884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9d4c3c4e-4ee3-4b31-a291-16bcf786b176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:53.170843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d186b5a-b46b-400c-9816-1544a1d93d56 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.171041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1058/2120] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:53.175378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c3c4e-4ee3-4b31-a291-16bcf786b176 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.177026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a960d3-8088-4102-add0-20a756f2d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.178557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a960d3-8088-4102-add0-20a756f2d92f admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.178557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a960d3-8088-4102-add0-20a756f2d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.178557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a960d3-8088-4102-add0-20a756f2d92f admin admin] PATH_INFO: `/v3/projects/c9f6a0b88aba4013ae2b7ff4d8b8b7bb/users/4101820050614472a381495a7bb4b896/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.187167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c3c4e-4ee3-4b31-a291-16bcf786b176 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.193114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.193777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.194038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.194331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.195063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:53.195343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.196987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.198762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a960d3-8088-4102-add0-20a756f2d92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f6a0b88aba4013ae2b7ff4d8b8b7bb, user_id=4101820050614472a381495a7bb4b896, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.201537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a960d3-8088-4102-add0-20a756f2d92f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.209795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:53.216038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1059/2121] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:46:53.225842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1063/2122] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:53 2022] PUT /identity/v3/projects/c9f6a0b88aba4013ae2b7ff4d8b8b7bb/users/4101820050614472a381495a7bb4b896/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:53.231429 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.231554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a960d3-8088-4102-add0-20a756f2d92f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.251760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171688e1-03be-4abb-8a45-ec74d1d8d94f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.325376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a960d3-8088-4102-add0-20a756f2d92f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.332650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137ff1-41dd-4547-a294-0f3b431c1ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.333999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137ff1-41dd-4547-a294-0f3b431c1ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.334413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137ff1-41dd-4547-a294-0f3b431c1ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.334684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a137ff1-41dd-4547-a294-0f3b431c1ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.335929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a137ff1-41dd-4547-a294-0f3b431c1ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.338836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a137ff1-41dd-4547-a294-0f3b431c1ae0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.351091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1064/2123] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:53.351727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad419826-7ad7-46cf-87e2-c00ab6522f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.352386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419826-7ad7-46cf-87e2-c00ab6522f79 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.352673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419826-7ad7-46cf-87e2-c00ab6522f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.352949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419826-7ad7-46cf-87e2-c00ab6522f79 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.353794 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad419826-7ad7-46cf-87e2-c00ab6522f79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.356060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad419826-7ad7-46cf-87e2-c00ab6522f79 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.359830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137ff1-41dd-4547-a294-0f3b431c1ae0 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.375888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a137ff1-41dd-4547-a294-0f3b431c1ae0 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.381552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ce367-2e07-4d92-987a-786a63086dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.382253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ce367-2e07-4d92-987a-786a63086dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.382647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ce367-2e07-4d92-987a-786a63086dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.382891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ce367-2e07-4d92-987a-786a63086dd3 admin admin] PATH_INFO: `/v3/projects/c9f6a0b88aba4013ae2b7ff4d8b8b7bb/users/4101820050614472a381495a7bb4b896/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.386034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ce367-2e07-4d92-987a-786a63086dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f6a0b88aba4013ae2b7ff4d8b8b7bb, user_id=4101820050614472a381495a7bb4b896, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.389122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1ce367-2e07-4d92-987a-786a63086dd3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.400185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1060/2124] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:53 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:53.404126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad419826-7ad7-46cf-87e2-c00ab6522f79 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.409409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1065/2125] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:53 2022] PUT /identity/v3/projects/c9f6a0b88aba4013ae2b7ff4d8b8b7bb/users/4101820050614472a381495a7bb4b896/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:53.422467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe159ed-11ea-44c5-acb3-75bb1dd507bc None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.422738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe159ed-11ea-44c5-acb3-75bb1dd507bc None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.423000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe159ed-11ea-44c5-acb3-75bb1dd507bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.438148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:53.472023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bfe159ed-11ea-44c5-acb3-75bb1dd507bc None None] MFA Rules not processed for user `4101820050614472a381495a7bb4b896`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:53.473909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bfe159ed-11ea-44c5-acb3-75bb1dd507bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:53.531274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad419826-7ad7-46cf-87e2-c00ab6522f79 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.538603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a96ec-be3b-45bc-8026-0c8f9bc8905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.539413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a96ec-be3b-45bc-8026-0c8f9bc8905c admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.539849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a96ec-be3b-45bc-8026-0c8f9bc8905c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.540626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a96ec-be3b-45bc-8026-0c8f9bc8905c admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.553264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a96ec-be3b-45bc-8026-0c8f9bc8905c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.555537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a96ec-be3b-45bc-8026-0c8f9bc8905c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.579057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1066/2126] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:53.592358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe159ed-11ea-44c5-acb3-75bb1dd507bc None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.594035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bfe159ed-11ea-44c5-acb3-75bb1dd507bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:53.607786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1061/2127] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:53 2022] POST /identity/v3/users => generated 285 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:53.609404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a96ec-be3b-45bc-8026-0c8f9bc8905c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.635652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a96ec-be3b-45bc-8026-0c8f9bc8905c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.650051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b67271-094c-4b94-89c4-3ac29f35230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.650716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67271-094c-4b94-89c4-3ac29f35230c admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.651004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67271-094c-4b94-89c4-3ac29f35230c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.651291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b67271-094c-4b94-89c4-3ac29f35230c admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.651941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b67271-094c-4b94-89c4-3ac29f35230c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.653606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b67271-094c-4b94-89c4-3ac29f35230c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.677052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1062/2128] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:53.677878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b67271-094c-4b94-89c4-3ac29f35230c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.710027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe159ed-11ea-44c5-acb3-75bb1dd507bc None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.715244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b67271-094c-4b94-89c4-3ac29f35230c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.725552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fdc6-1c17-4a50-83d5-8be1983c7647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.726372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fdc6-1c17-4a50-83d5-8be1983c7647 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.726729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fdc6-1c17-4a50-83d5-8be1983c7647 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.727060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660fdc6-1c17-4a50-83d5-8be1983c7647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.728586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fc03e-ddeb-4e06-8b61-b093e2b216a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.730458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc03e-ddeb-4e06-8b61-b093e2b216a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.730684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc03e-ddeb-4e06-8b61-b093e2b216a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.730986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fc03e-ddeb-4e06-8b61-b093e2b216a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.731679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc03e-ddeb-4e06-8b61-b093e2b216a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.733271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fc03e-ddeb-4e06-8b61-b093e2b216a9 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.740240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660fdc6-1c17-4a50-83d5-8be1983c7647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.741702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660fdc6-1c17-4a50-83d5-8be1983c7647 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.750913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1063/2129] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:53.752056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fc03e-ddeb-4e06-8b61-b093e2b216a9 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.754191 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1067/2130] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:53.767276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fc03e-ddeb-4e06-8b61-b093e2b216a9 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.774603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875263f-feee-4179-9b19-759f734ed310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.775406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875263f-feee-4179-9b19-759f734ed310 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.775690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875263f-feee-4179-9b19-759f734ed310 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.775967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875263f-feee-4179-9b19-759f734ed310 admin admin] PATH_INFO: `/v3/projects/5510fa61ffd04de09c194a352245987d/users/f71fafcf36604be9b38da06a7a3bb08e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.789833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fdc6-1c17-4a50-83d5-8be1983c7647 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.803751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875263f-feee-4179-9b19-759f734ed310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5510fa61ffd04de09c194a352245987d, user_id=f71fafcf36604be9b38da06a7a3bb08e, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.805776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660fdc6-1c17-4a50-83d5-8be1983c7647 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:53.807426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875263f-feee-4179-9b19-759f734ed310 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.811774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:53.812439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.812912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.813287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] PATH_INFO: `/v3/users/f721e94fd1c6472c8eb6da7bddbd0869` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.814634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f721e94fd1c6472c8eb6da7bddbd0869)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:53.816682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:53.832271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1064/2131] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:53 2022] PUT /identity/v3/projects/5510fa61ffd04de09c194a352245987d/users/f71fafcf36604be9b38da06a7a3bb08e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:53.840771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8d259-5d3c-424e-83e8-7b954bd91db5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.841320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8d259-5d3c-424e-83e8-7b954bd91db5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.841715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8d259-5d3c-424e-83e8-7b954bd91db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.875125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-68d8d259-5d3c-424e-83e8-7b954bd91db5 None None] MFA Rules not processed for user `f71fafcf36604be9b38da06a7a3bb08e`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:53.876387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-68d8d259-5d3c-424e-83e8-7b954bd91db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:53.889898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f721e94fd1c6472c8eb6da7bddbd0869'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.891274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f721e94fd1c6472c8eb6da7bddbd0869'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.902787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f721e94fd1c6472c8eb6da7bddbd0869'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.906555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:53.920362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f721e94fd1c6472c8eb6da7bddbd0869'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.930696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7162d7e3-f98c-4cec-a5b8-df455beeb278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f721e94fd1c6472c8eb6da7bddbd0869'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:53.940607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1068/2132] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:53 2022] DELETE /identity/v3/users/f721e94fd1c6472c8eb6da7bddbd0869 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:53.944713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7245e3-7961-48f0-a6dc-532e1efa25a6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:53.945210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7245e3-7961-48f0-a6dc-532e1efa25a6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:53.945914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7245e3-7961-48f0-a6dc-532e1efa25a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:53.955131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:53.969963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6a7245e3-7961-48f0-a6dc-532e1efa25a6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:53.972366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6a7245e3-7961-48f0-a6dc-532e1efa25a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:53.973813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1065/2133] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:53.989616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8d259-5d3c-424e-83e8-7b954bd91db5 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:53.991198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-68d8d259-5d3c-424e-83e8-7b954bd91db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:54.062903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1069/2134] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:54.070214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7245e3-7961-48f0-a6dc-532e1efa25a6 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:54.071750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6a7245e3-7961-48f0-a6dc-532e1efa25a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:54.097604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8d259-5d3c-424e-83e8-7b954bd91db5 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:54.159978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7245e3-7961-48f0-a6dc-532e1efa25a6 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:54.168541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:54.169827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:54.169827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:54.170147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:54.179330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43245b-c6ab-43bc-bc4a-c640b0b4da7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c0bf4de3a1442c8b856efbfac436fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:54.180378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43245b-c6ab-43bc-bc4a-c640b0b4da7e service glance] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:54.180906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43245b-c6ab-43bc-bc4a-c640b0b4da7e service glance] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:54.181289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e43245b-c6ab-43bc-bc4a-c640b0b4da7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:54.185101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:54.186594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:54.206193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1070/2135] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:54.273460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43245b-c6ab-43bc-bc4a-c640b0b4da7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:54.274925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e43245b-c6ab-43bc-bc4a-c640b0b4da7e service glance] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:54.286993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1066/2136] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:46:54.558039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:54.559751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:54.584458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e04a6-53dd-4538-a26c-05fe9f59f2fe service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:54.594101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:54.594877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:54.595164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:54.597223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] PATH_INFO: `/v3/projects/4232e6de85ab4ad488643006325f616d` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:54.599212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4232e6de85ab4ad488643006325f616d)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:54.606530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:54.702947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4232e6de85ab4ad488643006325f616d', 'request_id': 'req-b7dc48f3-139b-4ead-a45c-f993f3d2634d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:54.715069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4232e6de85ab4ad488643006325f616d', 'request_id': 'req-b7dc48f3-139b-4ead-a45c-f993f3d2634d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:54.733275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4232e6de85ab4ad488643006325f616d', 'request_id': 'req-b7dc48f3-139b-4ead-a45c-f993f3d2634d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:54.758239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] The token cache is being invalidate because project 4232e6de85ab4ad488643006325f616d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:54.758617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:54.760616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:54.763354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1071/2137] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:54 2022] DELETE /identity/v3/projects/4232e6de85ab4ad488643006325f616d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:54.767345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43245b-c6ab-43bc-bc4a-c640b0b4da7e service glance] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:54.788819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e43245b-c6ab-43bc-bc4a-c640b0b4da7e service glance] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:54.800338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:54.936909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:54.946189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:54.946607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:54.946894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] PATH_INFO: `/v3/users/4101820050614472a381495a7bb4b896` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:54.949351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4101820050614472a381495a7bb4b896)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:54.953702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:55.094353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4101820050614472a381495a7bb4b896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.113533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4101820050614472a381495a7bb4b896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.115233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4101820050614472a381495a7bb4b896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.116088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4101820050614472a381495a7bb4b896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.142723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-2ee05b56-53e3-49dd-81a0-981f53d48eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4101820050614472a381495a7bb4b896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.179280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1067/2138] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:54 2022] DELETE /identity/v3/users/4101820050614472a381495a7bb4b896 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:55.192001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:55.194269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:55.218456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc48f3-139b-4ead-a45c-f993f3d2634d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:55.254735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:55.322457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:55.323328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:55.323657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:55.323933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] PATH_INFO: `/v3/users/1db09048b3714b1bb1bb78fbdbbb3aee` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:55.325167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1db09048b3714b1bb1bb78fbdbbb3aee)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:55.327649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:55.401168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1db09048b3714b1bb1bb78fbdbbb3aee'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.401906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1db09048b3714b1bb1bb78fbdbbb3aee'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.413847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1db09048b3714b1bb1bb78fbdbbb3aee'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.436117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1db09048b3714b1bb1bb78fbdbbb3aee'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.446059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1db09048b3714b1bb1bb78fbdbbb3aee'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.461654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1072/2139] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:55 2022] DELETE /identity/v3/users/1db09048b3714b1bb1bb78fbdbbb3aee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:55.469152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d5084-5d33-4895-bab4-058e348a73c4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:55.470344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d5084-5d33-4895-bab4-058e348a73c4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:55.470706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d5084-5d33-4895-bab4-058e348a73c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:55.502484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b32d5084-5d33-4895-bab4-058e348a73c4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:55.504978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b32d5084-5d33-4895-bab4-058e348a73c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:55.606086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1068/2140] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:55.617838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:55.619738 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:55.628797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d5084-5d33-4895-bab4-058e348a73c4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:55.630744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b32d5084-5d33-4895-bab4-058e348a73c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:55.647035 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d5084-5d33-4895-bab4-058e348a73c4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:55.653719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:55.654481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:55.654958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:55.655336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] PATH_INFO: `/v3/projects/c9f6a0b88aba4013ae2b7ff4d8b8b7bb` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:55.656659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f6a0b88aba4013ae2b7ff4d8b8b7bb)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:55.659708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:55.699639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:55.735311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f6a0b88aba4013ae2b7ff4d8b8b7bb', 'request_id': 'req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.736439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f20aaf-9de2-48f9-883c-b0c71254552b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:55.755887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f6a0b88aba4013ae2b7ff4d8b8b7bb', 'request_id': 'req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.771742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f6a0b88aba4013ae2b7ff4d8b8b7bb', 'request_id': 'req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.815446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] The token cache is being invalidate because project c9f6a0b88aba4013ae2b7ff4d8b8b7bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:55.815998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.817007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3539dedd-4faf-4d6b-9fdf-f86a1be7c4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:55.819833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1069/2141] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:55 2022] DELETE /identity/v3/projects/c9f6a0b88aba4013ae2b7ff4d8b8b7bb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:46:55.825012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac8c7-6b9c-4a7c-8f62-7ca222238b51 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:55.825012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac8c7-6b9c-4a7c-8f62-7ca222238b51 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:55.825481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bac8c7-6b9c-4a7c-8f62-7ca222238b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:55.830630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a056e7-43c6-46dd-9a59-78565bb4ceb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:55.831257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a056e7-43c6-46dd-9a59-78565bb4ceb8 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:55.831632 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a056e7-43c6-46dd-9a59-78565bb4ceb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:55.832765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a056e7-43c6-46dd-9a59-78565bb4ceb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:55.833803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b4a056e7-43c6-46dd-9a59-78565bb4ceb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:55.858578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:55.860919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d3bac8c7-6b9c-4a7c-8f62-7ca222238b51 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:55.862407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d3bac8c7-6b9c-4a7c-8f62-7ca222238b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:55.955830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a056e7-43c6-46dd-9a59-78565bb4ceb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:55.962063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a056e7-43c6-46dd-9a59-78565bb4ceb8 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:56.007316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1073/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:56.017538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1070/2143] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:56.024979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203822e-5f71-40f1-9f8c-e6b1c3b73f4c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.025901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203822e-5f71-40f1-9f8c-e6b1c3b73f4c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.027835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e203822e-5f71-40f1-9f8c-e6b1c3b73f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.101105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e203822e-5f71-40f1-9f8c-e6b1c3b73f4c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:56.102383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e203822e-5f71-40f1-9f8c-e6b1c3b73f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:56.137239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1074/2144] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:56.141184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bac8c7-6b9c-4a7c-8f62-7ca222238b51 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.156906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bac8c7-6b9c-4a7c-8f62-7ca222238b51 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:56.170827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:56.171796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.171796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.171988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.172708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:46:56.173007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:56.174644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:56.209497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203822e-5f71-40f1-9f8c-e6b1c3b73f4c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.211500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1071/2145] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:46:56.220880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e203822e-5f71-40f1-9f8c-e6b1c3b73f4c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:56.240315 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:56.240948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.241233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.241514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.242275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:56.245054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:56.305595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1075/2146] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:56 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:46:56.307059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.318671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89113463-651d-48d4-840c-1b4ebd925237 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:56.401252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb58179-5453-4a18-86c4-422412446709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:56.401874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb58179-5453-4a18-86c4-422412446709 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.402333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb58179-5453-4a18-86c4-422412446709 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.402610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb58179-5453-4a18-86c4-422412446709 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.403450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb58179-5453-4a18-86c4-422412446709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:56.405198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb58179-5453-4a18-86c4-422412446709 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:56.419795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.423219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:56.434314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1072/2147] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:56 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:56.438608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb58179-5453-4a18-86c4-422412446709 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.439561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c4a0d-4c0c-4e23-9907-e2001be08103 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:56.446596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:56.448024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.448460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.448877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] PATH_INFO: `/v3/users/6cf5032d5c5c46bf80df61830c9eb113` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.450821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf5032d5c5c46bf80df61830c9eb113)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:56.452335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb58179-5453-4a18-86c4-422412446709 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:56.453861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:56.459863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8b272-f1cc-49a5-8d13-b7ed575ac61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:56.460586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b272-f1cc-49a5-8d13-b7ed575ac61e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.460930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b272-f1cc-49a5-8d13-b7ed575ac61e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.461433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b272-f1cc-49a5-8d13-b7ed575ac61e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.463513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8b272-f1cc-49a5-8d13-b7ed575ac61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:56.465543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8b272-f1cc-49a5-8d13-b7ed575ac61e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:56.479597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1073/2148] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:56.485194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8b272-f1cc-49a5-8d13-b7ed575ac61e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.512922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8b272-f1cc-49a5-8d13-b7ed575ac61e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:56.529351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ba1ed-56e8-44ba-a0a0-e5658f42490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:56.530111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba1ed-56e8-44ba-a0a0-e5658f42490d admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.530398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba1ed-56e8-44ba-a0a0-e5658f42490d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.530675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ba1ed-56e8-44ba-a0a0-e5658f42490d admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.531376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ba1ed-56e8-44ba-a0a0-e5658f42490d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:56.533293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ba1ed-56e8-44ba-a0a0-e5658f42490d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:56.549620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1074/2149] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:46:56.554590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ba1ed-56e8-44ba-a0a0-e5658f42490d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.557714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf5032d5c5c46bf80df61830c9eb113'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:56.559251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf5032d5c5c46bf80df61830c9eb113'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:56.576492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ba1ed-56e8-44ba-a0a0-e5658f42490d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:56.580841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf5032d5c5c46bf80df61830c9eb113'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:56.585614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe200f8-1c9a-4165-87de-3c7c05f67213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:56.586833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe200f8-1c9a-4165-87de-3c7c05f67213 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.587418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe200f8-1c9a-4165-87de-3c7c05f67213 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.588878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe200f8-1c9a-4165-87de-3c7c05f67213 admin admin] PATH_INFO: `/v3/projects/6cb72e8063414d08bb7a626fbfe240b7/users/7f1219cf9fd6435fb5b4e38e517c3592/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.592406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:56.611499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf5032d5c5c46bf80df61830c9eb113'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:56.628548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9851363f-bb06-4262-aa7f-12d3b4f88519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf5032d5c5c46bf80df61830c9eb113'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:56.646752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe200f8-1c9a-4165-87de-3c7c05f67213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cb72e8063414d08bb7a626fbfe240b7, user_id=7f1219cf9fd6435fb5b4e38e517c3592, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:56.648114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1076/2150] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:56 2022] DELETE /identity/v3/users/6cf5032d5c5c46bf80df61830c9eb113 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:56.652845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4de20d-eaaa-43a3-a26b-dc9b9953247d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.653348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4de20d-eaaa-43a3-a26b-dc9b9953247d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.653767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4de20d-eaaa-43a3-a26b-dc9b9953247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.654222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe200f8-1c9a-4165-87de-3c7c05f67213 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:56.698210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1075/2151] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:56 2022] PUT /identity/v3/projects/6cb72e8063414d08bb7a626fbfe240b7/users/7f1219cf9fd6435fb5b4e38e517c3592/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:56.700104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9a31e-d4b0-49ac-a646-e09d62b20916 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:56.700427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9a31e-d4b0-49ac-a646-e09d62b20916 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:56.700752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec9a31e-d4b0-49ac-a646-e09d62b20916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:56.717996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ff4de20d-eaaa-43a3-a26b-dc9b9953247d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:56.731000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ff4de20d-eaaa-43a3-a26b-dc9b9953247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:56.763582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-dec9a31e-d4b0-49ac-a646-e09d62b20916 None None] MFA Rules not processed for user `7f1219cf9fd6435fb5b4e38e517c3592`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:56.765763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dec9a31e-d4b0-49ac-a646-e09d62b20916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:56.826519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:56.854700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1077/2152] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:56.895166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4de20d-eaaa-43a3-a26b-dc9b9953247d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.896683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ff4de20d-eaaa-43a3-a26b-dc9b9953247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:56.947647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1076/2153] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:46:56.950956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9a31e-d4b0-49ac-a646-e09d62b20916 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:56.958122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dec9a31e-d4b0-49ac-a646-e09d62b20916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:56.995539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec9a31e-d4b0-49ac-a646-e09d62b20916 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.004390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4de20d-eaaa-43a3-a26b-dc9b9953247d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.004821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.005604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.006423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.006423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.006881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.009368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.018887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9c84-8cc8-4ee0-a004-61076a8c0fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.019635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9c84-8cc8-4ee0-a004-61076a8c0fdb service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.020443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9c84-8cc8-4ee0-a004-61076a8c0fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.020731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c9c84-8cc8-4ee0-a004-61076a8c0fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.044558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c9c84-8cc8-4ee0-a004-61076a8c0fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.048801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c9c84-8cc8-4ee0-a004-61076a8c0fdb service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.061025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1077/2154] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:46:56 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:57.062253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.064245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:57.066447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1078/2155] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:57.067505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9c84-8cc8-4ee0-a004-61076a8c0fdb service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.080575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c9c84-8cc8-4ee0-a004-61076a8c0fdb service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.173223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28743d6d-3a8d-4141-8a9a-287bd96c0fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.174187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28743d6d-3a8d-4141-8a9a-287bd96c0fab admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.174616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28743d6d-3a8d-4141-8a9a-287bd96c0fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.175034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28743d6d-3a8d-4141-8a9a-287bd96c0fab admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.175882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28743d6d-3a8d-4141-8a9a-287bd96c0fab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.178697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28743d6d-3a8d-4141-8a9a-287bd96c0fab admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.194240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cae361c-427c-4b02-9b5b-8b67d53a363f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.201873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.208209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1079/2156] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:46:57 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:46:57.212124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28743d6d-3a8d-4141-8a9a-287bd96c0fab admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.217144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.217466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.217744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] PATH_INFO: `/v3/projects/5f89bb05483a4c139ce88440e125f620` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.219036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f89bb05483a4c139ce88440e125f620)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.221277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.230786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28743d6d-3a8d-4141-8a9a-287bd96c0fab admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.237651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d9f29-1398-473f-b180-9185185bd3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.238475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d9f29-1398-473f-b180-9185185bd3bb admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.238873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d9f29-1398-473f-b180-9185185bd3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.242896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d9f29-1398-473f-b180-9185185bd3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.242896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d9f29-1398-473f-b180-9185185bd3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.246130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d9f29-1398-473f-b180-9185185bd3bb admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.267071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1080/2157] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:57.273327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d9f29-1398-473f-b180-9185185bd3bb admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.288881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d9f29-1398-473f-b180-9185185bd3bb admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.328811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f89bb05483a4c139ce88440e125f620', 'request_id': 'req-7e01aee2-ecde-45c6-936c-248c09e9c180'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.336925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:57.354646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f89bb05483a4c139ce88440e125f620', 'request_id': 'req-7e01aee2-ecde-45c6-936c-248c09e9c180'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.363483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f89bb05483a4c139ce88440e125f620', 'request_id': 'req-7e01aee2-ecde-45c6-936c-248c09e9c180'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.390598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] The token cache is being invalidate because project 5f89bb05483a4c139ce88440e125f620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:57.390962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.392616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.394733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1078/2158] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:57 2022] DELETE /identity/v3/projects/5f89bb05483a4c139ce88440e125f620 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:57.399887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.403736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:57.444107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.445706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.446214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.446672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] PATH_INFO: `/v3/projects/20d8eeff41ef4aae96008b4da7cc4b71/users/65b0542bd06c4209acfb7d6b2e315e9a/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.464915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d8eeff41ef4aae96008b4da7cc4b71, user_id=65b0542bd06c4209acfb7d6b2e315e9a, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.468120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.485705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1081/2159] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:57 2022] PUT /identity/v3/projects/20d8eeff41ef4aae96008b4da7cc4b71/users/65b0542bd06c4209acfb7d6b2e315e9a/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:57.489368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.492079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:57.497845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:57.519772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01aee2-ecde-45c6-936c-248c09e9c180 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.592445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.593121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.593404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.593678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] PATH_INFO: `/v3/users/7c0a0414bb414546af714df67d8901b0` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.595093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0a0414bb414546af714df67d8901b0)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.597161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.601049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cc51b-838a-4273-ab06-c8d64d5c5fe0 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.606931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.607668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.608041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.608412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.609142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.610850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.626543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1082/2160] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:46:57.627372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.629385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:57.656786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3cce8-698f-44c8-b0fa-ac218d040511 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.663682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.664660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.665045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.665425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] PATH_INFO: `/v3/projects/9375a9cdd95544d3b40f5ad82d9e9f48` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.667639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9375a9cdd95544d3b40f5ad82d9e9f48)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.670145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.690705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0a0414bb414546af714df67d8901b0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.710640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0a0414bb414546af714df67d8901b0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.711760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0a0414bb414546af714df67d8901b0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.713006 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0a0414bb414546af714df67d8901b0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.732302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0a0414bb414546af714df67d8901b0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.748459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9375a9cdd95544d3b40f5ad82d9e9f48', 'request_id': 'req-58b88418-d51f-43f5-aa12-cc228b6fe82d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.770791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1079/2161] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:57 2022] DELETE /identity/v3/users/7c0a0414bb414546af714df67d8901b0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:57.770791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.773244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:57.777586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9375a9cdd95544d3b40f5ad82d9e9f48', 'request_id': 'req-58b88418-d51f-43f5-aa12-cc228b6fe82d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.788708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:57.789546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9375a9cdd95544d3b40f5ad82d9e9f48', 'request_id': 'req-58b88418-d51f-43f5-aa12-cc228b6fe82d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.823727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] The token cache is being invalidate because project 9375a9cdd95544d3b40f5ad82d9e9f48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:57.824025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.824949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:57.826708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1083/2162] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:57 2022] DELETE /identity/v3/projects/9375a9cdd95544d3b40f5ad82d9e9f48 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:57.830873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:57.833884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:57.895585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1f064-a06c-42cf-8ca2-05ff618087db admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.902354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bed28-a389-423d-811e-3f155c58a8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:57.903097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bed28-a389-423d-811e-3f155c58a8cf admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.903378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bed28-a389-423d-811e-3f155c58a8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.903659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bed28-a389-423d-811e-3f155c58a8cf admin admin] PATH_INFO: `/v3/projects/20d8eeff41ef4aae96008b4da7cc4b71/users/65b0542bd06c4209acfb7d6b2e315e9a/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.905667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bed28-a389-423d-811e-3f155c58a8cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=20d8eeff41ef4aae96008b4da7cc4b71, user_id=65b0542bd06c4209acfb7d6b2e315e9a, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:57.908567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bed28-a389-423d-811e-3f155c58a8cf admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:57.914246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b88418-d51f-43f5-aa12-cc228b6fe82d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:57.928450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1080/2163] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:46:57 2022] PUT /identity/v3/projects/20d8eeff41ef4aae96008b4da7cc4b71/users/65b0542bd06c4209acfb7d6b2e315e9a/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:57.937300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5ebc-f556-45ff-8060-a839c640a318 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:57.937622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5ebc-f556-45ff-8060-a839c640a318 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:57.937857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef5ebc-f556-45ff-8060-a839c640a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:57.955300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:57.973345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f8ef5ebc-f556-45ff-8060-a839c640a318 None None] MFA Rules not processed for user `65b0542bd06c4209acfb7d6b2e315e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:57.975482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f8ef5ebc-f556-45ff-8060-a839c640a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:58.015915 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:58.017045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:58.017505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:58.017799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] PATH_INFO: `/v3/users/521f4bcf26a146b9a36474dab70212ad` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:58.019246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521f4bcf26a146b9a36474dab70212ad)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:58.022502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:58.117112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1081/2164] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:58.127030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef5ebc-f556-45ff-8060-a839c640a318 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:58.130732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f8ef5ebc-f556-45ff-8060-a839c640a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:58.144192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521f4bcf26a146b9a36474dab70212ad'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:58.146079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521f4bcf26a146b9a36474dab70212ad'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:58.161401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521f4bcf26a146b9a36474dab70212ad'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:58.188271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521f4bcf26a146b9a36474dab70212ad'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:58.211959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef5ebc-f556-45ff-8060-a839c640a318 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:58.220961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:58.221968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:58.223818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:58.224244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:58.226764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:58.229514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521f4bcf26a146b9a36474dab70212ad'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:58.244690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:58.246799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:58.249354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1084/2165] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:57 2022] DELETE /identity/v3/users/521f4bcf26a146b9a36474dab70212ad => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:58.262087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1082/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:46:58 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:46:58.764105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:58.766491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:58.931708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669013a-bf25-4914-96be-2275b04c1075 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:58.936811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:58.938186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:58.938477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:58.939484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] PATH_INFO: `/v3/projects/bea121af1e164c51af7a1fcd6c6d9d90` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:58.940751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea121af1e164c51af7a1fcd6c6d9d90)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:58.944332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:59.035203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea121af1e164c51af7a1fcd6c6d9d90', 'request_id': 'req-76708f26-e208-4b67-b92f-ef247ef7b046'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.037759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:59.058579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea121af1e164c51af7a1fcd6c6d9d90', 'request_id': 'req-76708f26-e208-4b67-b92f-ef247ef7b046'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.070544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea121af1e164c51af7a1fcd6c6d9d90', 'request_id': 'req-76708f26-e208-4b67-b92f-ef247ef7b046'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.096123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] The token cache is being invalidate because project bea121af1e164c51af7a1fcd6c6d9d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:59.096624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.097417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.100531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1085/2167] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:58 2022] DELETE /identity/v3/projects/bea121af1e164c51af7a1fcd6c6d9d90 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:59.105111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:59.128302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f4abc2-cd21-47f7-b504-d00609ffb41f service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:59.128515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:59.128515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:59.191399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:59.263634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76708f26-e208-4b67-b92f-ef247ef7b046 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:59.277027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:59.277932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:59.278376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:59.278976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] PATH_INFO: `/v3/projects/ef5fa1269bdd454e89c1ac3d2d5f09b2` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:59.285126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:59.285930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:59.286314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:59.286477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef5fa1269bdd454e89c1ac3d2d5f09b2)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:59.286896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] PATH_INFO: `/v3/users/576a5459ccb646ab986b23a577255896` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:59.289013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=576a5459ccb646ab986b23a577255896)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:59.290249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:59.292693 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:59.418520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576a5459ccb646ab986b23a577255896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.423123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef5fa1269bdd454e89c1ac3d2d5f09b2', 'request_id': 'req-a38f3ba0-526d-46f6-97eb-ccd4b5966888'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.439763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef5fa1269bdd454e89c1ac3d2d5f09b2', 'request_id': 'req-a38f3ba0-526d-46f6-97eb-ccd4b5966888'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.444308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576a5459ccb646ab986b23a577255896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.445439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576a5459ccb646ab986b23a577255896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.446555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576a5459ccb646ab986b23a577255896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.449872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef5fa1269bdd454e89c1ac3d2d5f09b2', 'request_id': 'req-a38f3ba0-526d-46f6-97eb-ccd4b5966888'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.460493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3aa66228-2c94-42b5-b15c-867130a56f1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576a5459ccb646ab986b23a577255896'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.464601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] The token cache is being invalidate because project ef5fa1269bdd454e89c1ac3d2d5f09b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:46:59.465028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.466371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.471060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1086/2168] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:59 2022] DELETE /identity/v3/projects/ef5fa1269bdd454e89c1ac3d2d5f09b2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:59.471060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:59.481245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:59.495611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1083/2169] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:59 2022] DELETE /identity/v3/users/576a5459ccb646ab986b23a577255896 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:59.497938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add015-4984-4712-bf1c-59c9db3aa9d6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:59.498343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add015-4984-4712-bf1c-59c9db3aa9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:59.498720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add015-4984-4712-bf1c-59c9db3aa9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:59.527535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-42add015-4984-4712-bf1c-59c9db3aa9d6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:59.530351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-42add015-4984-4712-bf1c-59c9db3aa9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:59.606808 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38f3ba0-526d-46f6-97eb-ccd4b5966888 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:59.627789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:59.640264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1084/2170] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:59.641410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add015-4984-4712-bf1c-59c9db3aa9d6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:59.645595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-42add015-4984-4712-bf1c-59c9db3aa9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:59.665195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add015-4984-4712-bf1c-59c9db3aa9d6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:59.671827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:59.672524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:59.672808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:59.673085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] PATH_INFO: `/v3/users/9f8b22bc870c4341b48d83e2e5821372` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:59.674733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8b22bc870c4341b48d83e2e5821372)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:59.677000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:59.680833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:46:59.682321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:59.682614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:59.682964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] PATH_INFO: `/v3/users/7f1219cf9fd6435fb5b4e38e517c3592` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:59.684992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1219cf9fd6435fb5b4e38e517c3592)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:46:59.689441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:46:59.754019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:46:59.764480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8b22bc870c4341b48d83e2e5821372'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.768591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1219cf9fd6435fb5b4e38e517c3592'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.769636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1219cf9fd6435fb5b4e38e517c3592'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.782269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1219cf9fd6435fb5b4e38e517c3592'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.788705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8b22bc870c4341b48d83e2e5821372'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.790387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8b22bc870c4341b48d83e2e5821372'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.791846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8b22bc870c4341b48d83e2e5821372'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.802813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1219cf9fd6435fb5b4e38e517c3592'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.803372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1049e08c-239f-43c1-a55f-28b35d055cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8b22bc870c4341b48d83e2e5821372'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.812224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-80d05392-7ad3-4dcc-80e0-7485abf32834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1219cf9fd6435fb5b4e38e517c3592'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:46:59.820386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1087/2171] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:59 2022] DELETE /identity/v3/users/7f1219cf9fd6435fb5b4e38e517c3592 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:59.825081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2f1c1-ca28-4330-88fb-78eb82864dd4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:59.825375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2f1c1-ca28-4330-88fb-78eb82864dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:59.825685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a2f1c1-ca28-4330-88fb-78eb82864dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:59.830889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1085/2172] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:46:59 2022] DELETE /identity/v3/users/9f8b22bc870c4341b48d83e2e5821372 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:46:59.833234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7138b8-3388-4496-b573-ee21647601a0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:46:59.833234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7138b8-3388-4496-b573-ee21647601a0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:46:59.833234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7138b8-3388-4496-b573-ee21647601a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:46:59.854640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-99a2f1c1-ca28-4330-88fb-78eb82864dd4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:59.856025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-99a2f1c1-ca28-4330-88fb-78eb82864dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:59.864957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ee7138b8-3388-4496-b573-ee21647601a0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:46:59.866890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ee7138b8-3388-4496-b573-ee21647601a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:46:59.959772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1088/2173] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:59.964874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2f1c1-ca28-4330-88fb-78eb82864dd4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:59.992775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a2f1c1-ca28-4330-88fb-78eb82864dd4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:46:59.994288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1086/2174] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:46:59.995520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7138b8-3388-4496-b573-ee21647601a0 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:46:59.997422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ee7138b8-3388-4496-b573-ee21647601a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.004937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.005558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.005845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.006110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.006767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:00.007156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.009042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.013235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7138b8-3388-4496-b573-ee21647601a0 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.018090 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.019056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.019056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.019271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] PATH_INFO: `/v3/projects/c9e0942028c94fbdb5841463dd06aff7` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.020843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9e0942028c94fbdb5841463dd06aff7)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.022156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1089/2175] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:46:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:47:00.022988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.026061 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.030862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.073086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:00.091444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9e0942028c94fbdb5841463dd06aff7', 'request_id': 'req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.101249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9e0942028c94fbdb5841463dd06aff7', 'request_id': 'req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.108537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9e0942028c94fbdb5841463dd06aff7', 'request_id': 'req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.117487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aa06f4-7da9-48b7-bd36-6a84dbd08e46 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.120484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] The token cache is being invalidate because project c9e0942028c94fbdb5841463dd06aff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:00.120783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.121456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.122984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1087/2176] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:46:59 2022] DELETE /identity/v3/projects/c9e0942028c94fbdb5841463dd06aff7 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:00.123817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.125292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.177412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b429870-782f-4dc7-818f-76c7bc126a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.178015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429870-782f-4dc7-818f-76c7bc126a2b service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.178324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429870-782f-4dc7-818f-76c7bc126a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.178602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b429870-782f-4dc7-818f-76c7bc126a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.180375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8b429870-782f-4dc7-818f-76c7bc126a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.187220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:00.207482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f98b2-8efd-4e24-bcbc-6d9a03e410b0 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.212392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.213877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.214158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.214440 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.215081 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.217074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.245093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1088/2177] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/projects => generated 389 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:00.245920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.248322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.249829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b429870-782f-4dc7-818f-76c7bc126a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.251310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b429870-782f-4dc7-818f-76c7bc126a2b service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.261473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1090/2178] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:00.262723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989c41-843d-41f2-8ee1-0cdf452474f4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.263008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989c41-843d-41f2-8ee1-0cdf452474f4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.263288 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4989c41-843d-41f2-8ee1-0cdf452474f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.290092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b4989c41-843d-41f2-8ee1-0cdf452474f4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:00.291954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b4989c41-843d-41f2-8ee1-0cdf452474f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.338472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb5db2-addf-41bf-a98a-a8b8ca99addb admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.345447 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.346197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.346484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.346811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] PATH_INFO: `/v3/projects/589e6abb53954f818a6d139fef7e4251` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.348441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] RBAC: Authorizing `identity:delete_project(project_id=589e6abb53954f818a6d139fef7e4251)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.350380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.390397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1091/2179] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:00.391550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4989c41-843d-41f2-8ee1-0cdf452474f4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.408577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4989c41-843d-41f2-8ee1-0cdf452474f4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.423441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '589e6abb53954f818a6d139fef7e4251', 'request_id': 'req-def924c5-26ad-4a32-ba1c-6f9bab93594c'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.441507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:00.449139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '589e6abb53954f818a6d139fef7e4251', 'request_id': 'req-def924c5-26ad-4a32-ba1c-6f9bab93594c'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.457702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '589e6abb53954f818a6d139fef7e4251', 'request_id': 'req-def924c5-26ad-4a32-ba1c-6f9bab93594c'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.474332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] The token cache is being invalidate because project 589e6abb53954f818a6d139fef7e4251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:00.474562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.475223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-def924c5-26ad-4a32-ba1c-6f9bab93594c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.476959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1089/2180] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:00 2022] DELETE /identity/v3/projects/589e6abb53954f818a6d139fef7e4251 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:00.478015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967937-0317-4e2b-a7e0-f9296045baaf None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.479206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967937-0317-4e2b-a7e0-f9296045baaf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.479479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38967937-0317-4e2b-a7e0-f9296045baaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.482376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831f971-75d3-422d-af96-a55c9c8b1991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.483207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831f971-75d3-422d-af96-a55c9c8b1991 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.483587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831f971-75d3-422d-af96-a55c9c8b1991 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.483986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831f971-75d3-422d-af96-a55c9c8b1991 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.485091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831f971-75d3-422d-af96-a55c9c8b1991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.487048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831f971-75d3-422d-af96-a55c9c8b1991 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.518279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1092/2181] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/users => generated 295 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:00.518279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d352d-0065-4d67-875c-c9d90ee859c8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.518279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d352d-0065-4d67-875c-c9d90ee859c8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.518927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d352d-0065-4d67-875c-c9d90ee859c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.521672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-38967937-0317-4e2b-a7e0-f9296045baaf None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:00.522950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-38967937-0317-4e2b-a7e0-f9296045baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.572421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1090/2182] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:00.575816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38967937-0317-4e2b-a7e0-f9296045baaf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.576890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-7b6d352d-0065-4d67-875c-c9d90ee859c8 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:00.578458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7b6d352d-0065-4d67-875c-c9d90ee859c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.580390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-38967937-0317-4e2b-a7e0-f9296045baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.588526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1093/2183] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:00.589373 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d352d-0065-4d67-875c-c9d90ee859c8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.608627 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d352d-0065-4d67-875c-c9d90ee859c8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.616150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38967937-0317-4e2b-a7e0-f9296045baaf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.618146 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.619440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.619742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.619999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.624249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:00.624640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453d1b1-fb25-4094-a636-6389c918903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.624799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.625245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d1b1-fb25-4094-a636-6389c918903d admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.625531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d1b1-fb25-4094-a636-6389c918903d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.625816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453d1b1-fb25-4094-a636-6389c918903d admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.626451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453d1b1-fb25-4094-a636-6389c918903d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.629875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.635963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453d1b1-fb25-4094-a636-6389c918903d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.650200 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1091/2184] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:00.653270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c41e-a410-4029-b84e-288e00dec07a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.653270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c41e-a410-4029-b84e-288e00dec07a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.653270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8c41e-a410-4029-b84e-288e00dec07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.663480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1094/2185] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:00.667347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.684404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-83e8c41e-a410-4029-b84e-288e00dec07a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:00.685925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-83e8c41e-a410-4029-b84e-288e00dec07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.694359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59568986-1ed8-4989-8065-3512f963e31d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.698704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1092/2186] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:00.701803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8c41e-a410-4029-b84e-288e00dec07a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.704933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6984b-f1f2-4460-9403-521aa19860f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.705559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6984b-f1f2-4460-9403-521aa19860f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.705834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6984b-f1f2-4460-9403-521aa19860f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.706150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6984b-f1f2-4460-9403-521aa19860f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.706770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6984b-f1f2-4460-9403-521aa19860f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.714616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda6984b-f1f2-4460-9403-521aa19860f2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.718439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8c41e-a410-4029-b84e-288e00dec07a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.726587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1095/2187] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:00.731865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6984b-f1f2-4460-9403-521aa19860f2 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.734756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3cea-6adc-49dc-9285-662b8cf4daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.735389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3cea-6adc-49dc-9285-662b8cf4daa2 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.735674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3cea-6adc-49dc-9285-662b8cf4daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.735949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca3cea-6adc-49dc-9285-662b8cf4daa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.737174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca3cea-6adc-49dc-9285-662b8cf4daa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.739110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca3cea-6adc-49dc-9285-662b8cf4daa2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.743704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda6984b-f1f2-4460-9403-521aa19860f2 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.753668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.754375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.754730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.756330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.756835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:00.757292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.759153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.779595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1096/2188] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:00.779796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1093/2189] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/projects => generated 373 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:00.779898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.779991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3cea-6adc-49dc-9285-662b8cf4daa2 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.781210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.797334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:00.818202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9430a-8d7c-4e76-9061-c78e45a16c9c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.855967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca3cea-6adc-49dc-9285-662b8cf4daa2 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.867495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabea26-e52c-4afa-b283-99bc29849001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.868259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabea26-e52c-4afa-b283-99bc29849001 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.868604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabea26-e52c-4afa-b283-99bc29849001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.871993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabea26-e52c-4afa-b283-99bc29849001 admin admin] PATH_INFO: `/v3/projects/6fee79a828254779bac5215aeae2f90d/users/dc2be77a8eaa425eb074262ef38e384e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.887266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabea26-e52c-4afa-b283-99bc29849001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fee79a828254779bac5215aeae2f90d, user_id=dc2be77a8eaa425eb074262ef38e384e, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.890021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabea26-e52c-4afa-b283-99bc29849001 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.890823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:00.891449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:00.891727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:00.891999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] PATH_INFO: `/v3/projects/6cb72e8063414d08bb7a626fbfe240b7` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:00.893141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cb72e8063414d08bb7a626fbfe240b7)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:00.895033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:00.903484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1094/2190] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:00 2022] PUT /identity/v3/projects/6fee79a828254779bac5215aeae2f90d/users/dc2be77a8eaa425eb074262ef38e384e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:00.904618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabea26-e52c-4afa-b283-99bc29849001 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.946474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cb72e8063414d08bb7a626fbfe240b7', 'request_id': 'req-46137b21-a93a-4780-97a0-9efdfb384108'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.954031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cb72e8063414d08bb7a626fbfe240b7', 'request_id': 'req-46137b21-a93a-4780-97a0-9efdfb384108'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.960710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cb72e8063414d08bb7a626fbfe240b7', 'request_id': 'req-46137b21-a93a-4780-97a0-9efdfb384108'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.971719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] The token cache is being invalidate because project 6cb72e8063414d08bb7a626fbfe240b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:00.972008 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.972720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:00.974326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1097/2191] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:00 2022] DELETE /identity/v3/projects/6cb72e8063414d08bb7a626fbfe240b7 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:00.975146 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:00.976606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:00.977396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabea26-e52c-4afa-b283-99bc29849001 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:00.983475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:01.054702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3c166-f02f-4205-9e04-ae8b5d68bdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.055287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c166-f02f-4205-9e04-ae8b5d68bdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.055573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c166-f02f-4205-9e04-ae8b5d68bdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.055851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3c166-f02f-4205-9e04-ae8b5d68bdd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.057114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3c166-f02f-4205-9e04-ae8b5d68bdd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.059131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab3c166-f02f-4205-9e04-ae8b5d68bdd4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.074005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46137b21-a93a-4780-97a0-9efdfb384108 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.079899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.080819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.081333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.081758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.082580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.085043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.093752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1095/2192] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/projects => generated 363 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:01.095180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863f3e-a1c1-4db8-9be4-2bf6a5812d30 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.100736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863f3e-a1c1-4db8-9be4-2bf6a5812d30 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.101306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11863f3e-a1c1-4db8-9be4-2bf6a5812d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.120520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1098/2193] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:00 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:01.120520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.120520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:01.136895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b3060d-92db-4b35-ac91-750383588689 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.141539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-11863f3e-a1c1-4db8-9be4-2bf6a5812d30 None None] MFA Rules not processed for user `dc2be77a8eaa425eb074262ef38e384e`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:01.142929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-11863f3e-a1c1-4db8-9be4-2bf6a5812d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:01.186700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:01.229704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.230335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.230611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.230906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] PATH_INFO: `/v3/users/65b0542bd06c4209acfb7d6b2e315e9a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.232040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] RBAC: Authorizing `identity:delete_user(user_id=65b0542bd06c4209acfb7d6b2e315e9a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.234080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.240556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1096/2194] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:01.241388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863f3e-a1c1-4db8-9be4-2bf6a5812d30 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.242653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-11863f3e-a1c1-4db8-9be4-2bf6a5812d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:01.255951 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11863f3e-a1c1-4db8-9be4-2bf6a5812d30 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.262594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.263343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.263653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.264165 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.264858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.267029 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.281723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65b0542bd06c4209acfb7d6b2e315e9a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:01.282461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65b0542bd06c4209acfb7d6b2e315e9a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:01.290334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65b0542bd06c4209acfb7d6b2e315e9a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:01.291793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1097/2195] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:01 2022] POST /identity/v3/users => generated 282 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:01.292950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.295110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:01.308253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65b0542bd06c4209acfb7d6b2e315e9a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:01.308434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51501a79-fe07-4262-ad73-1706e0f11c9b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.315575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.316211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.316494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.316948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.317605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.318050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65b0542bd06c4209acfb7d6b2e315e9a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:01.319881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.333009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1099/2196] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:01 2022] DELETE /identity/v3/users/65b0542bd06c4209acfb7d6b2e315e9a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:01.333996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.336283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:01.354187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:01.356887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1098/2197] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:01.357735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.365323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:01.386753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d10975-3d9c-457b-953d-b335fd46d7c6 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.449274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f57e1b-394f-490e-b79f-8e0bf718e04c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.454555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7f819-6bc3-4939-aa2a-c7e98cc82b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.455323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f819-6bc3-4939-aa2a-c7e98cc82b14 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.455609 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f819-6bc3-4939-aa2a-c7e98cc82b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.455910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c7f819-6bc3-4939-aa2a-c7e98cc82b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.456760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7f819-6bc3-4939-aa2a-c7e98cc82b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.458721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c7f819-6bc3-4939-aa2a-c7e98cc82b14 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.482455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21dce7-f257-42ce-9e1e-dbdca6d5eedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.483363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21dce7-f257-42ce-9e1e-dbdca6d5eedf admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.483746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21dce7-f257-42ce-9e1e-dbdca6d5eedf admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.484202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21dce7-f257-42ce-9e1e-dbdca6d5eedf admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.485661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21dce7-f257-42ce-9e1e-dbdca6d5eedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.487330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd21dce7-f257-42ce-9e1e-dbdca6d5eedf admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.498750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1099/2198] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:01.502485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21dce7-f257-42ce-9e1e-dbdca6d5eedf admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.504064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1100/2199] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:01 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:01.506895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7f819-6bc3-4939-aa2a-c7e98cc82b14 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.527984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21dce7-f257-42ce-9e1e-dbdca6d5eedf admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.632375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895580f-892a-4e18-ac3a-100a901a7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.633808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895580f-892a-4e18-ac3a-100a901a7403 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.634112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895580f-892a-4e18-ac3a-100a901a7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.644515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895580f-892a-4e18-ac3a-100a901a7403 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.646686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895580f-892a-4e18-ac3a-100a901a7403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.651579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c7f819-6bc3-4939-aa2a-c7e98cc82b14 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.651797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895580f-892a-4e18-ac3a-100a901a7403 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.657650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe9e39-1fda-4219-94af-68fc8f8cd70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.658708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9e39-1fda-4219-94af-68fc8f8cd70d admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.659095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9e39-1fda-4219-94af-68fc8f8cd70d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.659495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe9e39-1fda-4219-94af-68fc8f8cd70d admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.662823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe9e39-1fda-4219-94af-68fc8f8cd70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.662823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe9e39-1fda-4219-94af-68fc8f8cd70d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.669965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1100/2200] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:01.671093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895580f-892a-4e18-ac3a-100a901a7403 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.689080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895580f-892a-4e18-ac3a-100a901a7403 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.696392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b752b-8d58-40c7-b802-573ba92cabf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.697544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b752b-8d58-40c7-b802-573ba92cabf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.697825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b752b-8d58-40c7-b802-573ba92cabf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.698268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b752b-8d58-40c7-b802-573ba92cabf4 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.699063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b752b-8d58-40c7-b802-573ba92cabf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.701011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b752b-8d58-40c7-b802-573ba92cabf4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.711845 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1101/2201] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:01.716264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe9e39-1fda-4219-94af-68fc8f8cd70d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.743086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe9e39-1fda-4219-94af-68fc8f8cd70d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.762966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fb95a-a711-4ba1-83b2-36b743c629a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.765559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1101/2202] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:01 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:01.766279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b752b-8d58-40c7-b802-573ba92cabf4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.770681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb95a-a711-4ba1-83b2-36b743c629a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.770975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb95a-a711-4ba1-83b2-36b743c629a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.771290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fb95a-a711-4ba1-83b2-36b743c629a8 admin admin] PATH_INFO: `/v3/projects/3575dd52c8554e1c914ce7fe97db3229/users/ff789f77ae084e368727b54a4bbe60f9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.773675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:01.783999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b752b-8d58-40c7-b802-573ba92cabf4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.806693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fb95a-a711-4ba1-83b2-36b743c629a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3575dd52c8554e1c914ce7fe97db3229, user_id=ff789f77ae084e368727b54a4bbe60f9, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.807226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c267563-1b00-4b8c-a04e-d0f02a0e4a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:01.808340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267563-1b00-4b8c-a04e-d0f02a0e4a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.808844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267563-1b00-4b8c-a04e-d0f02a0e4a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.809471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c267563-1b00-4b8c-a04e-d0f02a0e4a47 admin admin] PATH_INFO: `/v3/projects/6024511fe5794891b987528938bd979d/users/3fe6bae714b543df81ee5f9f2663515f/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.810277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fb95a-a711-4ba1-83b2-36b743c629a8 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.831336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c267563-1b00-4b8c-a04e-d0f02a0e4a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6024511fe5794891b987528938bd979d, user_id=3fe6bae714b543df81ee5f9f2663515f, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:01.834394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1102/2203] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:01 2022] PUT /identity/v3/projects/3575dd52c8554e1c914ce7fe97db3229/users/ff789f77ae084e368727b54a4bbe60f9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:01.834543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c267563-1b00-4b8c-a04e-d0f02a0e4a47 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:01.835281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fb95a-a711-4ba1-83b2-36b743c629a8 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:01.856345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1102/2204] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:01 2022] PUT /identity/v3/projects/6024511fe5794891b987528938bd979d/users/3fe6bae714b543df81ee5f9f2663515f/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:01.864501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397044-22ed-4fae-9396-cff0ab0877ac None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.864501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397044-22ed-4fae-9396-cff0ab0877ac None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.864501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0397044-22ed-4fae-9396-cff0ab0877ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.890701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c0397044-22ed-4fae-9396-cff0ab0877ac None None] MFA Rules not processed for user `ff789f77ae084e368727b54a4bbe60f9`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:01.892395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c0397044-22ed-4fae-9396-cff0ab0877ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:01.925010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fb95a-a711-4ba1-83b2-36b743c629a8 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:01.942909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:01.989222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1103/2205] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:01.990561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9845-72ec-4515-98b7-62a8aea3a0c4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:01.990851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9845-72ec-4515-98b7-62a8aea3a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:01.991131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d9845-72ec-4515-98b7-62a8aea3a0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:01.999375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.000635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.001016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.001386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.002153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.004089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.016430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1103/2206] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:02.017658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.020907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.041996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-e59d9845-72ec-4515-98b7-62a8aea3a0c4 None None] MFA Rules not processed for user `3fe6bae714b543df81ee5f9f2663515f`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:02.043869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e59d9845-72ec-4515-98b7-62a8aea3a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.100022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27758089-4e12-467a-9314-a98d3455bd53 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.105160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cd487-b1ff-4106-a0b4-3af232140e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.105767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cd487-b1ff-4106-a0b4-3af232140e46 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.106045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cd487-b1ff-4106-a0b4-3af232140e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.106320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cd487-b1ff-4106-a0b4-3af232140e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.115194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cd487-b1ff-4106-a0b4-3af232140e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.116835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cd487-b1ff-4106-a0b4-3af232140e46 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.126965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1104/2207] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:02.127816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cd487-b1ff-4106-a0b4-3af232140e46 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.131234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1104/2208] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:02.131234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d9845-72ec-4515-98b7-62a8aea3a0c4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.131234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e59d9845-72ec-4515-98b7-62a8aea3a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.147275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cd487-b1ff-4106-a0b4-3af232140e46 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.150422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d9845-72ec-4515-98b7-62a8aea3a0c4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.154639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.155304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.155590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.155864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] PATH_INFO: `/v3/projects/80775d049b4a4e99a3096fec67b550d9/users/3497da5f156445998020208a141d2964/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.161832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.162538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.162882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.163218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] PATH_INFO: `/v3/projects/20d8eeff41ef4aae96008b4da7cc4b71` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.164460 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20d8eeff41ef4aae96008b4da7cc4b71)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.167188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.177419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80775d049b4a4e99a3096fec67b550d9, user_id=3497da5f156445998020208a141d2964, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.180116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.195527 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1105/2209] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:02 2022] PUT /identity/v3/projects/80775d049b4a4e99a3096fec67b550d9/users/3497da5f156445998020208a141d2964/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:02.196688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.199707 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.224513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20d8eeff41ef4aae96008b4da7cc4b71', 'request_id': 'req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.230372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:02.237726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20d8eeff41ef4aae96008b4da7cc4b71', 'request_id': 'req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.257384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20d8eeff41ef4aae96008b4da7cc4b71', 'request_id': 'req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.270474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] The token cache is being invalidate because project 20d8eeff41ef4aae96008b4da7cc4b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:02.270762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.271432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.273235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1105/2210] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:02 2022] DELETE /identity/v3/projects/20d8eeff41ef4aae96008b4da7cc4b71 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:02.273770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.276088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.279639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91756aaa-a442-42b8-8814-ec7318c0f3b6 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.332251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:02.339744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.340560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.341259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.341853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.344725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.355958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac4889-fb15-47dc-966e-c18cb33c7c2a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.362596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.363242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.363527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.363801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] PATH_INFO: `/v3/users/ff789f77ae084e368727b54a4bbe60f9` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.365485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff789f77ae084e368727b54a4bbe60f9)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.367833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.409902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.411505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.417009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff789f77ae084e368727b54a4bbe60f9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.425602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1106/2211] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:02.427026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.429031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.441348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff789f77ae084e368727b54a4bbe60f9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.442814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff789f77ae084e368727b54a4bbe60f9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.443457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff789f77ae084e368727b54a4bbe60f9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.447997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e172e6f-2542-4cfb-b0ba-ba60614f594e service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.454213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5521e-d9fd-4b8c-b282-9894ca41740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.454840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5521e-d9fd-4b8c-b282-9894ca41740c admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.455121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5521e-d9fd-4b8c-b282-9894ca41740c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.455398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5521e-d9fd-4b8c-b282-9894ca41740c admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.456146 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5521e-d9fd-4b8c-b282-9894ca41740c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.457816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5521e-d9fd-4b8c-b282-9894ca41740c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.459508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff789f77ae084e368727b54a4bbe60f9'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:02.470967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1107/2212] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:02.477016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1106/2213] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:02 2022] DELETE /identity/v3/users/ff789f77ae084e368727b54a4bbe60f9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:02.477016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.477268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21333e-16d7-4183-b9da-fefe98218fe0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.477268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21333e-16d7-4183-b9da-fefe98218fe0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.477268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21333e-16d7-4183-b9da-fefe98218fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.477472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.499281 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ef21333e-16d7-4183-b9da-fefe98218fe0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:02.501189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ef21333e-16d7-4183-b9da-fefe98218fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.560946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06069e-3a86-4e5a-913a-d494afcfd550 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.565838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bbb69-a472-49ee-96e4-1416bb9ac5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.566500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bbb69-a472-49ee-96e4-1416bb9ac5ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.566785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bbb69-a472-49ee-96e4-1416bb9ac5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.567055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bbb69-a472-49ee-96e4-1416bb9ac5ab admin admin] PATH_INFO: `/v3/projects/80775d049b4a4e99a3096fec67b550d9/users/3497da5f156445998020208a141d2964/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.569150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bbb69-a472-49ee-96e4-1416bb9ac5ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=80775d049b4a4e99a3096fec67b550d9, user_id=3497da5f156445998020208a141d2964, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.572845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53bbb69-a472-49ee-96e4-1416bb9ac5ab admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.576347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:02.595788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1107/2214] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:02 2022] PUT /identity/v3/projects/80775d049b4a4e99a3096fec67b550d9/users/3497da5f156445998020208a141d2964/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:02.595788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe8701-111e-48b6-ab24-f18bc05a0c0b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.595788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe8701-111e-48b6-ab24-f18bc05a0c0b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.596197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1108/2215] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:02.596295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe8701-111e-48b6-ab24-f18bc05a0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.596381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70644e5-9fd2-4f7d-8685-a5334c05a15c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.596381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70644e5-9fd2-4f7d-8685-a5334c05a15c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.596381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70644e5-9fd2-4f7d-8685-a5334c05a15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.616340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2abe8701-111e-48b6-ab24-f18bc05a0c0b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:02.617781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2abe8701-111e-48b6-ab24-f18bc05a0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.620730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b70644e5-9fd2-4f7d-8685-a5334c05a15c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:02.621914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b70644e5-9fd2-4f7d-8685-a5334c05a15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.708045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1109/2216] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:02.711005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15836b5-34f1-444f-8447-aa46b9945be4 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.711557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15836b5-34f1-444f-8447-aa46b9945be4 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.712061 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15836b5-34f1-444f-8447-aa46b9945be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.715616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1108/2217] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:02.716700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe8701-111e-48b6-ab24-f18bc05a0c0b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.726846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe8701-111e-48b6-ab24-f18bc05a0c0b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.734209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.734691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.735411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.735411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.736064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:02.736410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.738145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.753580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1109/2218] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:02.753860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a15836b5-34f1-444f-8447-aa46b9945be4 None None] MFA Rules not processed for user `3497da5f156445998020208a141d2964`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:02.755181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a15836b5-34f1-444f-8447-aa46b9945be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.757642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.760972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.837639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:02.861983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b01cd-9f38-4f40-a0ad-84b708598ac4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.866901 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aeebf-bb12-42c6-9c41-07b0d0f4e143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.867680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aeebf-bb12-42c6-9c41-07b0d0f4e143 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.868158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aeebf-bb12-42c6-9c41-07b0d0f4e143 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.869011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4aeebf-bb12-42c6-9c41-07b0d0f4e143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.881187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aeebf-bb12-42c6-9c41-07b0d0f4e143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.883133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4aeebf-bb12-42c6-9c41-07b0d0f4e143 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.894625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1110/2219] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:02.895497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aeebf-bb12-42c6-9c41-07b0d0f4e143 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.905943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4aeebf-bb12-42c6-9c41-07b0d0f4e143 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:02.911467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424faf63-8e1b-4801-9b63-2f009829b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:02.912066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424faf63-8e1b-4801-9b63-2f009829b93c admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:02.912662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424faf63-8e1b-4801-9b63-2f009829b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:02.912662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424faf63-8e1b-4801-9b63-2f009829b93c admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:02.913256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424faf63-8e1b-4801-9b63-2f009829b93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:02.914974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1110/2220] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:02 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:02.915258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424faf63-8e1b-4801-9b63-2f009829b93c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:02.926426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15836b5-34f1-444f-8447-aa46b9945be4 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:02.927851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a15836b5-34f1-444f-8447-aa46b9945be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:02.952711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1111/2221] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:02 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:02.954255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424faf63-8e1b-4801-9b63-2f009829b93c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.002095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15836b5-34f1-444f-8447-aa46b9945be4 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.042739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424faf63-8e1b-4801-9b63-2f009829b93c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.053112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bceb2-ff70-4263-801d-7a31c8c76269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.054198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bceb2-ff70-4263-801d-7a31c8c76269 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.054793 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bceb2-ff70-4263-801d-7a31c8c76269 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.055096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482bceb2-ff70-4263-801d-7a31c8c76269 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.055761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bceb2-ff70-4263-801d-7a31c8c76269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.070147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482bceb2-ff70-4263-801d-7a31c8c76269 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.076345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.077229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.077747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.078235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.083640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:03.110289 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1112/2222] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:02 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:47:03.111615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bceb2-ff70-4263-801d-7a31c8c76269 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.128381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482bceb2-ff70-4263-801d-7a31c8c76269 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.137055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca3429-5f1f-48cf-88ef-b1b09bc5141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.138482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3429-5f1f-48cf-88ef-b1b09bc5141c admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.138856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3429-5f1f-48cf-88ef-b1b09bc5141c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.139033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca3429-5f1f-48cf-88ef-b1b09bc5141c admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.140584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca3429-5f1f-48cf-88ef-b1b09bc5141c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.144302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca3429-5f1f-48cf-88ef-b1b09bc5141c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.160489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1113/2223] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:03.164541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca3429-5f1f-48cf-88ef-b1b09bc5141c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.175555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.176571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca3429-5f1f-48cf-88ef-b1b09bc5141c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.182241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db537cbe-70ea-48d7-b181-4c2369bd6710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.182706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.183207 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db537cbe-70ea-48d7-b181-4c2369bd6710 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.183652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db537cbe-70ea-48d7-b181-4c2369bd6710 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.184071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db537cbe-70ea-48d7-b181-4c2369bd6710 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.184895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db537cbe-70ea-48d7-b181-4c2369bd6710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.186745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db537cbe-70ea-48d7-b181-4c2369bd6710 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.199334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1111/2224] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:47:03.200914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.202346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.204713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1114/2225] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:03.208653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db537cbe-70ea-48d7-b181-4c2369bd6710 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.224501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db537cbe-70ea-48d7-b181-4c2369bd6710 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.231801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79234943-a208-428d-bd2e-9bf0e0f6107b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.232134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234943-a208-428d-bd2e-9bf0e0f6107b admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.232678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234943-a208-428d-bd2e-9bf0e0f6107b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.232880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234943-a208-428d-bd2e-9bf0e0f6107b admin admin] PATH_INFO: `/v3/projects/c8d6328974e24e53abcbf0e68b398542/users/cf39cd57454e48a0a0ff56feef37febc/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.241161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eef9e7c-7a62-4e40-84d4-6d85e62a6d04 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.253809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.254210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79234943-a208-428d-bd2e-9bf0e0f6107b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d6328974e24e53abcbf0e68b398542, user_id=cf39cd57454e48a0a0ff56feef37febc, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.254456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.254742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.255021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] PATH_INFO: `/v3/projects/3575dd52c8554e1c914ce7fe97db3229` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.256199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3575dd52c8554e1c914ce7fe97db3229)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.257668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79234943-a208-428d-bd2e-9bf0e0f6107b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.258106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.273158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1115/2226] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:03 2022] PUT /identity/v3/projects/c8d6328974e24e53abcbf0e68b398542/users/cf39cd57454e48a0a0ff56feef37febc/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:03.287362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e93d-13df-4201-85a2-a63a03eaf154 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.287831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e93d-13df-4201-85a2-a63a03eaf154 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.288311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4e93d-13df-4201-85a2-a63a03eaf154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.298164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:03.322822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ade4e93d-13df-4201-85a2-a63a03eaf154 None None] MFA Rules not processed for user `cf39cd57454e48a0a0ff56feef37febc`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:03.324398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ade4e93d-13df-4201-85a2-a63a03eaf154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.354991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3575dd52c8554e1c914ce7fe97db3229', 'request_id': 'req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.368385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3575dd52c8554e1c914ce7fe97db3229', 'request_id': 'req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.378296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3575dd52c8554e1c914ce7fe97db3229', 'request_id': 'req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.391405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] The token cache is being invalidate because project 3575dd52c8554e1c914ce7fe97db3229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:03.391705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.392463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a29e1157-1f8e-4454-9039-dfb8e16e2ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.394728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1112/2227] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:03 2022] DELETE /identity/v3/projects/3575dd52c8554e1c914ce7fe97db3229 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:03.402174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc350c6f-6f4e-42d7-a698-3cf984a8f1d8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.402174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc350c6f-6f4e-42d7-a698-3cf984a8f1d8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.402469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc350c6f-6f4e-42d7-a698-3cf984a8f1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.423639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1116/2228] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:03.425283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4e93d-13df-4201-85a2-a63a03eaf154 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.426598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ade4e93d-13df-4201-85a2-a63a03eaf154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.432155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-fc350c6f-6f4e-42d7-a698-3cf984a8f1d8 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:03.433638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fc350c6f-6f4e-42d7-a698-3cf984a8f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.512187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1113/2229] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:03.513106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc350c6f-6f4e-42d7-a698-3cf984a8f1d8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.515139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fc350c6f-6f4e-42d7-a698-3cf984a8f1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.528879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc350c6f-6f4e-42d7-a698-3cf984a8f1d8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.534301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40572d71-fe4e-443e-82d5-c95b4d9327b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.534940 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572d71-fe4e-443e-82d5-c95b4d9327b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.535280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572d71-fe4e-443e-82d5-c95b4d9327b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.535559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40572d71-fe4e-443e-82d5-c95b4d9327b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.536380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40572d71-fe4e-443e-82d5-c95b4d9327b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.537773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4e93d-13df-4201-85a2-a63a03eaf154 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.539202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40572d71-fe4e-443e-82d5-c95b4d9327b1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.545915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.546704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.546985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.547274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] PATH_INFO: `/v3/users/dc2be77a8eaa425eb074262ef38e384e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.548505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2be77a8eaa425eb074262ef38e384e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.551069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.579325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1114/2230] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:03 2022] POST /identity/v3/projects => generated 379 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:03.581647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad0ef-694b-4968-92df-957ba19f0fd7 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.581938 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad0ef-694b-4968-92df-957ba19f0fd7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.582213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ad0ef-694b-4968-92df-957ba19f0fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.612253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-615ad0ef-694b-4968-92df-957ba19f0fd7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:03.613460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-615ad0ef-694b-4968-92df-957ba19f0fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.628863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:03.640036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2be77a8eaa425eb074262ef38e384e'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.655001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2be77a8eaa425eb074262ef38e384e'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.655933 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2be77a8eaa425eb074262ef38e384e'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.656704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2be77a8eaa425eb074262ef38e384e'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.672374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2be77a8eaa425eb074262ef38e384e'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:03.687432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1117/2231] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:03 2022] DELETE /identity/v3/users/dc2be77a8eaa425eb074262ef38e384e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:03.688397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.691221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.695038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1115/2232] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:03.696432 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a3d2a-9648-4fd1-8400-50192722b5fb None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.697565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a3d2a-9648-4fd1-8400-50192722b5fb None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.697864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a3d2a-9648-4fd1-8400-50192722b5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.720571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a58a3d2a-9648-4fd1-8400-50192722b5fb None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:03.721777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a58a3d2a-9648-4fd1-8400-50192722b5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.753905 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:03.786467 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12d4dd-acf0-4b07-9d01-96407dc2b3a9 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.792039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.792719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.792991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.793258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.794266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.796399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.801226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1116/2233] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:03.802409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a3d2a-9648-4fd1-8400-50192722b5fb None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.823275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a3d2a-9648-4fd1-8400-50192722b5fb None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.828653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.831806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1118/2234] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:03 2022] POST /identity/v3/users => generated 296 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:03.831945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.831945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.831945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.832153 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.832253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:03.832253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.832399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:03.832988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.846165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1117/2235] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:03.847095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.859148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b44e5bb-2276-4eb7-ac26-17b0860cff22 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.866462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0c888-985b-43a5-9509-814e74c16456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.867359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0c888-985b-43a5-9509-814e74c16456 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.867727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0c888-985b-43a5-9509-814e74c16456 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.868069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0c888-985b-43a5-9509-814e74c16456 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.869618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0c888-985b-43a5-9509-814e74c16456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.871405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0c888-985b-43a5-9509-814e74c16456 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.885958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1118/2236] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:03.886934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0c888-985b-43a5-9509-814e74c16456 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.902036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0c888-985b-43a5-9509-814e74c16456 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.908733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01984c5f-3466-4628-924c-c7ed3ebe7046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.909600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984c5f-3466-4628-924c-c7ed3ebe7046 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.909960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984c5f-3466-4628-924c-c7ed3ebe7046 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.910347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984c5f-3466-4628-924c-c7ed3ebe7046 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.911317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01984c5f-3466-4628-924c-c7ed3ebe7046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.913571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01984c5f-3466-4628-924c-c7ed3ebe7046 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.926612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d546c23-2789-4732-8290-ac484da23680 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:03.932934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9038-7d45-417f-93cd-42d6ef291c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:03.933675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9038-7d45-417f-93cd-42d6ef291c11 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:03.934279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9038-7d45-417f-93cd-42d6ef291c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:03.934495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f9038-7d45-417f-93cd-42d6ef291c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:03.954698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f9038-7d45-417f-93cd-42d6ef291c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:03.956245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f9038-7d45-417f-93cd-42d6ef291c11 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:03.964158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1119/2237] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:03 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:03.964158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01984c5f-3466-4628-924c-c7ed3ebe7046 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.967550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1119/2238] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:03.968418 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9038-7d45-417f-93cd-42d6ef291c11 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:03.979296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f9038-7d45-417f-93cd-42d6ef291c11 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.036217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:04.045284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01984c5f-3466-4628-924c-c7ed3ebe7046 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.054485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97051-a43f-4d24-8776-781fba788c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.055708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97051-a43f-4d24-8776-781fba788c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.055946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97051-a43f-4d24-8776-781fba788c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.056416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e97051-a43f-4d24-8776-781fba788c51 admin admin] PATH_INFO: `/v3/projects/65a86a40b54b4efebd39c4eb71f7fd6e/users/6963ad2e641946de948b2314b4b6b7dc/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.061180 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b6798-b4ee-4357-9686-1aa37ad678b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.061808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b6798-b4ee-4357-9686-1aa37ad678b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.062193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b6798-b4ee-4357-9686-1aa37ad678b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.062501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b6798-b4ee-4357-9686-1aa37ad678b6 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.063432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b6798-b4ee-4357-9686-1aa37ad678b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.066388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b6798-b4ee-4357-9686-1aa37ad678b6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.078499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97051-a43f-4d24-8776-781fba788c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a86a40b54b4efebd39c4eb71f7fd6e, user_id=6963ad2e641946de948b2314b4b6b7dc, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.081469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e97051-a43f-4d24-8776-781fba788c51 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.102570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1120/2239] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:03 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:04.104366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1120/2240] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:03 2022] PUT /identity/v3/projects/65a86a40b54b4efebd39c4eb71f7fd6e/users/6963ad2e641946de948b2314b4b6b7dc/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:04.106484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b6798-b4ee-4357-9686-1aa37ad678b6 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.108219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97051-a43f-4d24-8776-781fba788c51 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.116959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b6798-b4ee-4357-9686-1aa37ad678b6 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.203099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e97051-a43f-4d24-8776-781fba788c51 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.209816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46813574-70fa-4fca-8b72-5dec7bae98c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.210581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813574-70fa-4fca-8b72-5dec7bae98c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.211329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813574-70fa-4fca-8b72-5dec7bae98c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.211898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813574-70fa-4fca-8b72-5dec7bae98c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.212465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46813574-70fa-4fca-8b72-5dec7bae98c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.214452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46813574-70fa-4fca-8b72-5dec7bae98c0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.223699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:04.230163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7822c4-7817-4b65-ba83-0812e36d3d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.230843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7822c4-7817-4b65-ba83-0812e36d3d0e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.231353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7822c4-7817-4b65-ba83-0812e36d3d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.231480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7822c4-7817-4b65-ba83-0812e36d3d0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.232061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7822c4-7817-4b65-ba83-0812e36d3d0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.232391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1121/2241] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:04.233683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7822c4-7817-4b65-ba83-0812e36d3d0e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.235445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46813574-70fa-4fca-8b72-5dec7bae98c0 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.245864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1121/2242] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:04.248568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46813574-70fa-4fca-8b72-5dec7bae98c0 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.252569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7822c4-7817-4b65-ba83-0812e36d3d0e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.257054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e430e-eefe-4743-8a0e-4ea3e53fdd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.257744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e430e-eefe-4743-8a0e-4ea3e53fdd29 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.258047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e430e-eefe-4743-8a0e-4ea3e53fdd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.258313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e430e-eefe-4743-8a0e-4ea3e53fdd29 admin admin] PATH_INFO: `/v3/projects/65a86a40b54b4efebd39c4eb71f7fd6e/users/6963ad2e641946de948b2314b4b6b7dc/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.266269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e430e-eefe-4743-8a0e-4ea3e53fdd29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a86a40b54b4efebd39c4eb71f7fd6e, user_id=6963ad2e641946de948b2314b4b6b7dc, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.269098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4e430e-eefe-4743-8a0e-4ea3e53fdd29 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.271684 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7822c4-7817-4b65-ba83-0812e36d3d0e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.278085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07526f15-752e-40a3-9bea-9033880c4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.278870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07526f15-752e-40a3-9bea-9033880c4e29 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.279158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07526f15-752e-40a3-9bea-9033880c4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.279433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07526f15-752e-40a3-9bea-9033880c4e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.280124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07526f15-752e-40a3-9bea-9033880c4e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.282048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07526f15-752e-40a3-9bea-9033880c4e29 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.297381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1122/2244] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:04.297601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1122/2244] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:04 2022] PUT /identity/v3/projects/65a86a40b54b4efebd39c4eb71f7fd6e/users/6963ad2e641946de948b2314b4b6b7dc/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:04.301561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07526f15-752e-40a3-9bea-9033880c4e29 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.302353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f1a5b-19f0-4c2a-a3bd-a2b9a000647e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.302665 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f1a5b-19f0-4c2a-a3bd-a2b9a000647e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.302948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f1a5b-19f0-4c2a-a3bd-a2b9a000647e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.321131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07526f15-752e-40a3-9bea-9033880c4e29 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.348292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-195f1a5b-19f0-4c2a-a3bd-a2b9a000647e None None] MFA Rules not processed for user `6963ad2e641946de948b2314b4b6b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:04.349526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-195f1a5b-19f0-4c2a-a3bd-a2b9a000647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:04.435416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.436216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.436697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.437039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] PATH_INFO: `/v3/projects/72fedd2e2f8e4e0992d1b7e9ecd85c22/users/2cb4563a03f6449eb5c65bd000d341d4/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.454764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72fedd2e2f8e4e0992d1b7e9ecd85c22, user_id=2cb4563a03f6449eb5c65bd000d341d4, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.457894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.465206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1123/2245] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:04 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:04.466146 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f1a5b-19f0-4c2a-a3bd-a2b9a000647e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.467512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-195f1a5b-19f0-4c2a-a3bd-a2b9a000647e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:04.483411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1123/2246] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:04 2022] PUT /identity/v3/projects/72fedd2e2f8e4e0992d1b7e9ecd85c22/users/2cb4563a03f6449eb5c65bd000d341d4/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:04.484376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.486002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f1a5b-19f0-4c2a-a3bd-a2b9a000647e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.488566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:04.548312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:04.551895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.552565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.552849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.553126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] PATH_INFO: `/v3/projects/6fee79a828254779bac5215aeae2f90d` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.554433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd78430-277a-4d6f-8409-0b5ac8ee10d6 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.554565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fee79a828254779bac5215aeae2f90d)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.556991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.559663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef09382-de06-4e74-8a19-67cb186ad6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.560340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09382-de06-4e74-8a19-67cb186ad6ee service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.560629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09382-de06-4e74-8a19-67cb186ad6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.560904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef09382-de06-4e74-8a19-67cb186ad6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.605674 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fee79a828254779bac5215aeae2f90d', 'request_id': 'req-22303cb6-9ca2-452a-9d2b-2533ff64d350'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.613480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fee79a828254779bac5215aeae2f90d', 'request_id': 'req-22303cb6-9ca2-452a-9d2b-2533ff64d350'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.620229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fee79a828254779bac5215aeae2f90d', 'request_id': 'req-22303cb6-9ca2-452a-9d2b-2533ff64d350'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.624548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef09382-de06-4e74-8a19-67cb186ad6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.626033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef09382-de06-4e74-8a19-67cb186ad6ee service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.632272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] The token cache is being invalidate because project 6fee79a828254779bac5215aeae2f90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:04.632556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.633252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.638241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1124/2248] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:04 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:04.639408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d675-7a9f-40ad-a39e-b1484b30f369 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.639672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1124/2248] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:04 2022] DELETE /identity/v3/projects/6fee79a828254779bac5215aeae2f90d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:04.639788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d675-7a9f-40ad-a39e-b1484b30f369 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.640056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d675-7a9f-40ad-a39e-b1484b30f369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.640758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.642573 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:04.647563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:04.670552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9265d675-7a9f-40ad-a39e-b1484b30f369 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:04.672613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9265d675-7a9f-40ad-a39e-b1484b30f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:04.747222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22303cb6-9ca2-452a-9d2b-2533ff64d350 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.752462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.753218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.753594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.753967 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] PATH_INFO: `/v3/users/3497da5f156445998020208a141d2964` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.756458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3497da5f156445998020208a141d2964)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.758726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.764089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1125/2249] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:04.773780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265d675-7a9f-40ad-a39e-b1484b30f369 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:04.775475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9265d675-7a9f-40ad-a39e-b1484b30f369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:04.837043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3497da5f156445998020208a141d2964'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.839227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3497da5f156445998020208a141d2964'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.850196 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3497da5f156445998020208a141d2964'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.874860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265d675-7a9f-40ad-a39e-b1484b30f369 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:04.880131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:04.880783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:04.881068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:04.881346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:04.883389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:04.885467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3497da5f156445998020208a141d2964'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.899054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:04.901043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3497da5f156445998020208a141d2964'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:04.901177 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:04.912412 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1125/2250] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:04 2022] DELETE /identity/v3/users/3497da5f156445998020208a141d2964 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:04.917333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1126/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:47:05.156524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:05.158487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:05.248755 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8847661-2279-4510-8af8-0cf53572427e admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:05.255174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:05.255822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:05.257379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:05.257716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] PATH_INFO: `/v3/users/cf39cd57454e48a0a0ff56feef37febc` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:05.259731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf39cd57454e48a0a0ff56feef37febc)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:05.272217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:05.298064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:05.334161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf39cd57454e48a0a0ff56feef37febc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.335423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf39cd57454e48a0a0ff56feef37febc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.350821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf39cd57454e48a0a0ff56feef37febc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.380388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:05.383082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:05.389130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf39cd57454e48a0a0ff56feef37febc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.399058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e86cb217-7209-43a8-a7bd-d5e54dbb08a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf39cd57454e48a0a0ff56feef37febc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.410318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1126/2252] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:05 2022] DELETE /identity/v3/users/cf39cd57454e48a0a0ff56feef37febc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:05.416159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2cbd-dc21-41df-99af-6d20e2ce62e8 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:05.416554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2cbd-dc21-41df-99af-6d20e2ce62e8 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:05.416834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2cbd-dc21-41df-99af-6d20e2ce62e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:05.465381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:05.472320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bd8f2cbd-dc21-41df-99af-6d20e2ce62e8 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:05.473803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bd8f2cbd-dc21-41df-99af-6d20e2ce62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:05.498221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ed1f7-0a76-4475-8e2f-4671bee75561 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:05.610468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1127/2253] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:05.614802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2cbd-dc21-41df-99af-6d20e2ce62e8 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:05.617434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bd8f2cbd-dc21-41df-99af-6d20e2ce62e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:05.644473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2cbd-dc21-41df-99af-6d20e2ce62e8 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:05.645679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:05.647102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:05.647815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:05.648932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:05.651680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:05.651919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:05.652729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:05.653254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:05.653619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] PATH_INFO: `/v3/projects/80775d049b4a4e99a3096fec67b550d9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:05.657435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80775d049b4a4e99a3096fec67b550d9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:05.659693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:05.754434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80775d049b4a4e99a3096fec67b550d9', 'request_id': 'req-695139ab-4e5f-4c2c-b10f-2df23530256c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.766872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80775d049b4a4e99a3096fec67b550d9', 'request_id': 'req-695139ab-4e5f-4c2c-b10f-2df23530256c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.771302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:05.773457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:05.782756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80775d049b4a4e99a3096fec67b550d9', 'request_id': 'req-695139ab-4e5f-4c2c-b10f-2df23530256c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.793461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1127/2254] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:05.794722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:05.796405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:05.810475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] The token cache is being invalidate because project 80775d049b4a4e99a3096fec67b550d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:05.814729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.817007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-695139ab-4e5f-4c2c-b10f-2df23530256c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:05.824098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1128/2255] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:05 2022] DELETE /identity/v3/projects/80775d049b4a4e99a3096fec67b550d9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:05.825693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574986e-c205-453c-97a2-7c13133698f5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:05.826657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574986e-c205-453c-97a2-7c13133698f5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:05.826657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574986e-c205-453c-97a2-7c13133698f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:05.878724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e574986e-c205-453c-97a2-7c13133698f5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:05.879720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e574986e-c205-453c-97a2-7c13133698f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:05.938302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:05.956713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7197f-98d1-48db-b9b0-e2ca43714897 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:06.121896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1129/2256] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:06.125170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e55eb8-b89d-46d5-9ff4-1cabe7059f20 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.125461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e55eb8-b89d-46d5-9ff4-1cabe7059f20 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.125735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e55eb8-b89d-46d5-9ff4-1cabe7059f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.126736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:06.127346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.127618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.127880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.132940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:06.164382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:06.166210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:06.171243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-66e55eb8-b89d-46d5-9ff4-1cabe7059f20 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:06.172832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-66e55eb8-b89d-46d5-9ff4-1cabe7059f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:06.193257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1128/2257] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:06.193456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1130/2258] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:06.199384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:06.209005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:06.218623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364feb2-cbfa-4939-a161-55e6bd01a09c service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:06.240854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:06.242919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.243276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.244358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.245301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:06.245691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:06.247522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:06.273268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1129/2259] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:06.278384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e55eb8-b89d-46d5-9ff4-1cabe7059f20 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:06.289577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e55eb8-b89d-46d5-9ff4-1cabe7059f20 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:06.295383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7daa6-0d57-4713-be62-05a936b3b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:06.295988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7daa6-0d57-4713-be62-05a936b3b4bb admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.296301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7daa6-0d57-4713-be62-05a936b3b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.296577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7daa6-0d57-4713-be62-05a936b3b4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.297277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7daa6-0d57-4713-be62-05a936b3b4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:06.299515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7daa6-0d57-4713-be62-05a936b3b4bb admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:06.339246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1131/2260] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:06 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:06.343688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:06.354360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3516bc87-9c62-450d-9e64-645b9901c06f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:06.429469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcbe06-0dd3-4b9f-be54-590fb8c1bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:06.430093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbe06-0dd3-4b9f-be54-590fb8c1bf5a admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.430392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbe06-0dd3-4b9f-be54-590fb8c1bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.430777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcbe06-0dd3-4b9f-be54-590fb8c1bf5a admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.432053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcbe06-0dd3-4b9f-be54-590fb8c1bf5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:06.434106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fcbe06-0dd3-4b9f-be54-590fb8c1bf5a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:06.462833 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7daa6-0d57-4713-be62-05a936b3b4bb admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:06.463330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1130/2261] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:06 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:47:06.486292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7daa6-0d57-4713-be62-05a936b3b4bb admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:06.502756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400a0e1-21a2-4ba0-b68b-e5adc8b64682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:06.503576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a0e1-21a2-4ba0-b68b-e5adc8b64682 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.504152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a0e1-21a2-4ba0-b68b-e5adc8b64682 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.507789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400a0e1-21a2-4ba0-b68b-e5adc8b64682 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.509964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400a0e1-21a2-4ba0-b68b-e5adc8b64682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:06.512889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400a0e1-21a2-4ba0-b68b-e5adc8b64682 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:06.537077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1132/2262] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:06.541410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcbe06-0dd3-4b9f-be54-590fb8c1bf5a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:06.554333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcbe06-0dd3-4b9f-be54-590fb8c1bf5a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:06.559181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6998abe-f783-41c7-ba0a-1f73cafbc32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:06.559876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998abe-f783-41c7-ba0a-1f73cafbc32e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.560257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998abe-f783-41c7-ba0a-1f73cafbc32e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.560599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6998abe-f783-41c7-ba0a-1f73cafbc32e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.561775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6998abe-f783-41c7-ba0a-1f73cafbc32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:06.563082 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6998abe-f783-41c7-ba0a-1f73cafbc32e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:06.574960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1131/2263] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:06.579485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400a0e1-21a2-4ba0-b68b-e5adc8b64682 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:06.591009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400a0e1-21a2-4ba0-b68b-e5adc8b64682 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:06.595993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:06.596757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.597119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.597458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] PATH_INFO: `/v3/projects/c17e440dbe1a444e8abf135cb2350c68/users/737df239c66241e8a5e1b47c34264754/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.626358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17e440dbe1a444e8abf135cb2350c68, user_id=737df239c66241e8a5e1b47c34264754, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:06.629335 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:06.651174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1133/2264] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:06 2022] PUT /identity/v3/projects/c17e440dbe1a444e8abf135cb2350c68/users/737df239c66241e8a5e1b47c34264754/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:06.669282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f48fa-ee71-4c73-b73e-d0ff9bf6f5d3 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.669878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f48fa-ee71-4c73-b73e-d0ff9bf6f5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.670408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f48fa-ee71-4c73-b73e-d0ff9bf6f5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.725366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f77f48fa-ee71-4c73-b73e-d0ff9bf6f5d3 None None] MFA Rules not processed for user `737df239c66241e8a5e1b47c34264754`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:06.732922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f77f48fa-ee71-4c73-b73e-d0ff9bf6f5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:06.791322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:06.797155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:06.882462 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1132/2265] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:06.883489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f48fa-ee71-4c73-b73e-d0ff9bf6f5d3 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:06.969966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa4745-22ae-4b75-94b7-fc463ff1dab9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:06.975456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:06.978852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:06.979192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:06.979664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] PATH_INFO: `/v3/projects/c8d6328974e24e53abcbf0e68b398542` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:06.982021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d6328974e24e53abcbf0e68b398542)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:06.986372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:06.999377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f48fa-ee71-4c73-b73e-d0ff9bf6f5d3 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:07.004928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47066191-f1b2-4f33-8a81-86096429f5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:07.005851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47066191-f1b2-4f33-8a81-86096429f5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:07.006992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47066191-f1b2-4f33-8a81-86096429f5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:07.008223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47066191-f1b2-4f33-8a81-86096429f5f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:07.009179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47066191-f1b2-4f33-8a81-86096429f5f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:07.013122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47066191-f1b2-4f33-8a81-86096429f5f3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:07.020125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:07.060814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1133/2266] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:06 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:07.066301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47066191-f1b2-4f33-8a81-86096429f5f3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:07.068672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d6328974e24e53abcbf0e68b398542', 'request_id': 'req-b14fb320-5206-4715-a3da-3dbb7da77b62'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.087623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d6328974e24e53abcbf0e68b398542', 'request_id': 'req-b14fb320-5206-4715-a3da-3dbb7da77b62'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.104334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d6328974e24e53abcbf0e68b398542', 'request_id': 'req-b14fb320-5206-4715-a3da-3dbb7da77b62'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.106554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:07.130501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] The token cache is being invalidate because project c8d6328974e24e53abcbf0e68b398542 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:07.131136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.131746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.133957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1134/2267] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:06 2022] DELETE /identity/v3/projects/c8d6328974e24e53abcbf0e68b398542 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:07.137897 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:07.139932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:07.197336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47066191-f1b2-4f33-8a81-86096429f5f3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:07.217899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:07.219262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:07.219589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:07.219919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:07.220648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:07.222744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:07.307302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1134/2268] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:07 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:07.309521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:07.326155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:07.340324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14fb320-5206-4715-a3da-3dbb7da77b62 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:07.350260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efefb6-8836-4dd2-a2ff-a45f79c8e536 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:07.358326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:07.358989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:07.359275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:07.359553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] PATH_INFO: `/v3/users/6963ad2e641946de948b2314b4b6b7dc` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:07.361200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6963ad2e641946de948b2314b4b6b7dc)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:07.363183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:07.367897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0876269-19bd-4aa8-a877-e0aef4ccda3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:07.369803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0876269-19bd-4aa8-a877-e0aef4ccda3e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:07.370091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0876269-19bd-4aa8-a877-e0aef4ccda3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:07.370372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0876269-19bd-4aa8-a877-e0aef4ccda3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:07.371674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0876269-19bd-4aa8-a877-e0aef4ccda3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:07.373310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0876269-19bd-4aa8-a877-e0aef4ccda3e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:07.428573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1135/2269] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:07.431471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0876269-19bd-4aa8-a877-e0aef4ccda3e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:07.450192 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0876269-19bd-4aa8-a877-e0aef4ccda3e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:07.465748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:07.466377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:07.466704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:07.467266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:07.475536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:07.482409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:07.522145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6963ad2e641946de948b2314b4b6b7dc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.523471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6963ad2e641946de948b2314b4b6b7dc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.540820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1136/2270] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:07.544559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6963ad2e641946de948b2314b4b6b7dc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.545503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:07.548070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:07.566522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9462ca-087d-4bf7-86f1-e164b29259f1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:07.574039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49803c8-01a6-4b34-b50e-fc271d685ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:07.574719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49803c8-01a6-4b34-b50e-fc271d685ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:07.575252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49803c8-01a6-4b34-b50e-fc271d685ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:07.575503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49803c8-01a6-4b34-b50e-fc271d685ca8 admin admin] PATH_INFO: `/v3/projects/7545519d58b14100ae5f29411277851d/users/b220b96ff8dc4425b1b24f5bbcb8e5d2/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:07.578508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6963ad2e641946de948b2314b4b6b7dc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.604210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2a91cb59-cd42-42d0-9cd4-117630143fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6963ad2e641946de948b2314b4b6b7dc'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:07.607663 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49803c8-01a6-4b34-b50e-fc271d685ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7545519d58b14100ae5f29411277851d, user_id=b220b96ff8dc4425b1b24f5bbcb8e5d2, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:07.610428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49803c8-01a6-4b34-b50e-fc271d685ca8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:07.613128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1135/2271] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:07 2022] DELETE /identity/v3/users/6963ad2e641946de948b2314b4b6b7dc => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:07.651397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1137/2272] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:07 2022] PUT /identity/v3/projects/7545519d58b14100ae5f29411277851d/users/b220b96ff8dc4425b1b24f5bbcb8e5d2/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:07.652825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991f72-f0f2-475b-9ca7-19b1db1fd7a9 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:07.653121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991f72-f0f2-475b-9ca7-19b1db1fd7a9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:07.653404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991f72-f0f2-475b-9ca7-19b1db1fd7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:07.718455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-fb991f72-f0f2-475b-9ca7-19b1db1fd7a9 None None] MFA Rules not processed for user `b220b96ff8dc4425b1b24f5bbcb8e5d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:07.721220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fb991f72-f0f2-475b-9ca7-19b1db1fd7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:07.840453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:07.852154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1136/2273] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:07.854707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49803c8-01a6-4b34-b50e-fc271d685ca8 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:07.969642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49803c8-01a6-4b34-b50e-fc271d685ca8 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:07.974538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:07.975151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:07.975431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:07.975703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:07.976450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:07.979167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:08.016022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1138/2274] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:07 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:08.016890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991f72-f0f2-475b-9ca7-19b1db1fd7a9 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:08.042566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991f72-f0f2-475b-9ca7-19b1db1fd7a9 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:08.135543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:08.138666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:08.167830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9880bd-c098-44a5-a4e8-0272ff7c07f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:08.169073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9880bd-c098-44a5-a4e8-0272ff7c07f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.169653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9880bd-c098-44a5-a4e8-0272ff7c07f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.170110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9880bd-c098-44a5-a4e8-0272ff7c07f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.171042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9880bd-c098-44a5-a4e8-0272ff7c07f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:08.173389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9880bd-c098-44a5-a4e8-0272ff7c07f0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:08.180525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:08.215132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1137/2275] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:08 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:47:08.216560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9880bd-c098-44a5-a4e8-0272ff7c07f0 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:08.231404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9880bd-c098-44a5-a4e8-0272ff7c07f0 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:08.246654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2f316-7ce8-4c67-9ec3-711890f163e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:08.247355 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2f316-7ce8-4c67-9ec3-711890f163e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.247706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2f316-7ce8-4c67-9ec3-711890f163e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.248966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2f316-7ce8-4c67-9ec3-711890f163e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.249741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2f316-7ce8-4c67-9ec3-711890f163e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:08.251965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2f316-7ce8-4c67-9ec3-711890f163e4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:08.270375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1138/2276] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:08.275057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2f316-7ce8-4c67-9ec3-711890f163e4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:08.288295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2f316-7ce8-4c67-9ec3-711890f163e4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:08.303385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c9e9a-e72e-454b-99df-574c34f3a2c2 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:08.308618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c9a7-0e3d-44f8-b571-f12d96b5ed55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:08.309381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c9a7-0e3d-44f8-b571-f12d96b5ed55 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.309737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c9a7-0e3d-44f8-b571-f12d96b5ed55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.310086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11c9a7-0e3d-44f8-b571-f12d96b5ed55 admin admin] PATH_INFO: `/v3/projects/5e83169dbd7a4c7b8faa508d72973de0/users/53883f331ef94d5a8993618a41cf38cd/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.310577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:08.311359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.311812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.313691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] PATH_INFO: `/v3/projects/65a86a40b54b4efebd39c4eb71f7fd6e` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.315549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a86a40b54b4efebd39c4eb71f7fd6e)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:08.321185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:08.351387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c9a7-0e3d-44f8-b571-f12d96b5ed55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e83169dbd7a4c7b8faa508d72973de0, user_id=53883f331ef94d5a8993618a41cf38cd, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:08.355082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11c9a7-0e3d-44f8-b571-f12d96b5ed55 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:08.385017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1139/2277] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:08 2022] PUT /identity/v3/projects/5e83169dbd7a4c7b8faa508d72973de0/users/53883f331ef94d5a8993618a41cf38cd/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:08.390024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c9a7-0e3d-44f8-b571-f12d96b5ed55 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:08.400699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a86a40b54b4efebd39c4eb71f7fd6e', 'request_id': 'req-d30e8b38-e48a-4846-9f08-f364ff61aa45'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:08.418390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a86a40b54b4efebd39c4eb71f7fd6e', 'request_id': 'req-d30e8b38-e48a-4846-9f08-f364ff61aa45'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:08.440381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a86a40b54b4efebd39c4eb71f7fd6e', 'request_id': 'req-d30e8b38-e48a-4846-9f08-f364ff61aa45'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:08.463544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] The token cache is being invalidate because project 65a86a40b54b4efebd39c4eb71f7fd6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:08.464938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:08.465924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-d30e8b38-e48a-4846-9f08-f364ff61aa45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:08.468934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1139/2278] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:08 2022] DELETE /identity/v3/projects/65a86a40b54b4efebd39c4eb71f7fd6e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:08.472732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840569-3f8b-4754-823a-dd760697a15d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.473168 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840569-3f8b-4754-823a-dd760697a15d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.473936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36840569-3f8b-4754-823a-dd760697a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.499244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11c9a7-0e3d-44f8-b571-f12d96b5ed55 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:08.501546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-36840569-3f8b-4754-823a-dd760697a15d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:08.502761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-36840569-3f8b-4754-823a-dd760697a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:08.611299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:08.611922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.612220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.612497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.613150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:08.614777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:08.621977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:08.637925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1140/2279] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:08.641455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:08.645119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:08.684394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1140/2280] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:08.685674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e62c-83de-4de4-a445-811b46881fda None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.685780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d2dc84-ffcc-422a-8343-3739cc1c1616 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:08.686195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e62c-83de-4de4-a445-811b46881fda None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.686707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09e62c-83de-4de4-a445-811b46881fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.720383 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9e09e62c-83de-4de4-a445-811b46881fda None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:08.720684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d97ed20-ee3d-4424-8d60-3a859bf99ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:08.721382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97ed20-ee3d-4424-8d60-3a859bf99ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.721663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97ed20-ee3d-4424-8d60-3a859bf99ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.721941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d97ed20-ee3d-4424-8d60-3a859bf99ad5 admin admin] PATH_INFO: `/v3/projects/5e83169dbd7a4c7b8faa508d72973de0/users/53883f331ef94d5a8993618a41cf38cd/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.722566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9e09e62c-83de-4de4-a445-811b46881fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:08.729745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97ed20-ee3d-4424-8d60-3a859bf99ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e83169dbd7a4c7b8faa508d72973de0, user_id=53883f331ef94d5a8993618a41cf38cd, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:08.732497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d97ed20-ee3d-4424-8d60-3a859bf99ad5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:08.737629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1141/2281] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:08.741853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09e62c-83de-4de4-a445-811b46881fda None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:08.756891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09e62c-83de-4de4-a445-811b46881fda None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:08.760137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1141/2282] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:08 2022] PUT /identity/v3/projects/5e83169dbd7a4c7b8faa508d72973de0/users/53883f331ef94d5a8993618a41cf38cd/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:08.771428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895044b9-080a-4812-8548-adb2228882d9 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.771716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895044b9-080a-4812-8548-adb2228882d9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.771991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895044b9-080a-4812-8548-adb2228882d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.812825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:08.858127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-895044b9-080a-4812-8548-adb2228882d9 None None] MFA Rules not processed for user `53883f331ef94d5a8993618a41cf38cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:08.859357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-895044b9-080a-4812-8548-adb2228882d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:08.861715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:08.862619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.863111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.863355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.864273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:08.864719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:08.866811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:08.903698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1142/2283] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:08.905140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:08.927108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027eb80-639f-4b0d-af44-139be96f1edb admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:08.960991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9eb73-034e-4ced-9a1a-df7e5beacf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:08.961841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9eb73-034e-4ced-9a1a-df7e5beacf66 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:08.962724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9eb73-034e-4ced-9a1a-df7e5beacf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:08.963166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9eb73-034e-4ced-9a1a-df7e5beacf66 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:08.964361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9eb73-034e-4ced-9a1a-df7e5beacf66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:08.965905 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9eb73-034e-4ced-9a1a-df7e5beacf66 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:09.002194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1142/2284] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:09.012891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895044b9-080a-4812-8548-adb2228882d9 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:09.014724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-895044b9-080a-4812-8548-adb2228882d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:09.035723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1143/2285] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:08 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:09.037166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9eb73-034e-4ced-9a1a-df7e5beacf66 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:09.174311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895044b9-080a-4812-8548-adb2228882d9 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:09.241414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9eb73-034e-4ced-9a1a-df7e5beacf66 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:09.251727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1525e8-7f75-46a1-b7db-e4ea0de93a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:09.252415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1525e8-7f75-46a1-b7db-e4ea0de93a16 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:09.252712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1525e8-7f75-46a1-b7db-e4ea0de93a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:09.252986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1525e8-7f75-46a1-b7db-e4ea0de93a16 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:09.254097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1525e8-7f75-46a1-b7db-e4ea0de93a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:09.256304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1525e8-7f75-46a1-b7db-e4ea0de93a16 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:09.284548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1144/2286] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:09 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:09.289474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1525e8-7f75-46a1-b7db-e4ea0de93a16 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:09.303868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1525e8-7f75-46a1-b7db-e4ea0de93a16 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:09.304286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:09.305237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:09.305525 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:09.306463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:09.315407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387382b-6611-4b0d-b101-3025c3a5c61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:09.316244 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387382b-6611-4b0d-b101-3025c3a5c61a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:09.316537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387382b-6611-4b0d-b101-3025c3a5c61a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:09.317093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387382b-6611-4b0d-b101-3025c3a5c61a admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:09.317904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387382b-6611-4b0d-b101-3025c3a5c61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:09.320618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387382b-6611-4b0d-b101-3025c3a5c61a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:09.338020 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1145/2287] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:09.339109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387382b-6611-4b0d-b101-3025c3a5c61a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:09.352755 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387382b-6611-4b0d-b101-3025c3a5c61a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:09.360775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1532a-c962-4c9b-a488-5055141cb41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:09.361574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1532a-c962-4c9b-a488-5055141cb41e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:09.361896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1532a-c962-4c9b-a488-5055141cb41e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:09.362158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1532a-c962-4c9b-a488-5055141cb41e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:09.363037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1532a-c962-4c9b-a488-5055141cb41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:09.365271 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1532a-c962-4c9b-a488-5055141cb41e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:09.398503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1146/2288] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:09.404198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1532a-c962-4c9b-a488-5055141cb41e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:09.406659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:09.419205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1532a-c962-4c9b-a488-5055141cb41e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:09.424403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d12043-c86e-497a-b581-96cd8cf723fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:09.425306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12043-c86e-497a-b581-96cd8cf723fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:09.425492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12043-c86e-497a-b581-96cd8cf723fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:09.425746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d12043-c86e-497a-b581-96cd8cf723fc admin admin] PATH_INFO: `/v3/projects/19f4581a35ae41209bb170ebc63b8eec/users/63e782a27e764b1ca9302094f788815f/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:09.446952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d12043-c86e-497a-b581-96cd8cf723fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f4581a35ae41209bb170ebc63b8eec, user_id=63e782a27e764b1ca9302094f788815f, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:09.452595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d12043-c86e-497a-b581-96cd8cf723fc admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:09.478481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1147/2289] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:09 2022] PUT /identity/v3/projects/19f4581a35ae41209bb170ebc63b8eec/users/63e782a27e764b1ca9302094f788815f/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:09.479302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:09.480272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d52e8-eb8e-4d41-ad7e-c3d908f482ea None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:09.480774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d52e8-eb8e-4d41-ad7e-c3d908f482ea None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:09.480907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:09.481217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8d52e8-eb8e-4d41-ad7e-c3d908f482ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:09.504313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1143/2290] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:47:09.531846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6c8d52e8-eb8e-4d41-ad7e-c3d908f482ea None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:09.533728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6c8d52e8-eb8e-4d41-ad7e-c3d908f482ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:09.572586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:09.574686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:09.591454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d11aa5-45c7-4638-af94-98fc9bd6c044 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:09.618096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:09.648858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1148/2291] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:09.657635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d52e8-eb8e-4d41-ad7e-c3d908f482ea None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:09.660015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6c8d52e8-eb8e-4d41-ad7e-c3d908f482ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:09.684069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:09.684795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:09.685079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:09.685352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:09.687348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:09.745860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8d52e8-eb8e-4d41-ad7e-c3d908f482ea None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:09.752651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611a279-1a3f-40b7-aba3-c611acbaef25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:09.753984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611a279-1a3f-40b7-aba3-c611acbaef25 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:09.754277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611a279-1a3f-40b7-aba3-c611acbaef25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:09.755533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611a279-1a3f-40b7-aba3-c611acbaef25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:09.769317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611a279-1a3f-40b7-aba3-c611acbaef25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:09.770304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:09.770886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611a279-1a3f-40b7-aba3-c611acbaef25 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:09.772603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:09.784211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1149/2292] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:47:09.796711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1144/2293] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:12.417165 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fc2a6-3e25-4f70-b804-2d45f3896d54 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:12.417679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fc2a6-3e25-4f70-b804-2d45f3896d54 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:12.417774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1fc2a6-3e25-4f70-b804-2d45f3896d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:12.482705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3d1fc2a6-3e25-4f70-b804-2d45f3896d54 None None] MFA Rules not processed for user `2cb4563a03f6449eb5c65bd000d341d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:12.482705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3d1fc2a6-3e25-4f70-b804-2d45f3896d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:12.622158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1150/2294] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:12.627326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:12.629692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:12.645979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4276e-72f0-4a2b-a6d9-96a88fc2afca service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:12.653084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33ef32-9edc-4203-a9dd-ecb3b947adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:12.654039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33ef32-9edc-4203-a9dd-ecb3b947adfe admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:12.654549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33ef32-9edc-4203-a9dd-ecb3b947adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:12.655119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33ef32-9edc-4203-a9dd-ecb3b947adfe admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:12.656329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33ef32-9edc-4203-a9dd-ecb3b947adfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:12.658650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33ef32-9edc-4203-a9dd-ecb3b947adfe admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:12.750664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1145/2295] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:12 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:12.754888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fc2a6-3e25-4f70-b804-2d45f3896d54 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:12.773842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1fc2a6-3e25-4f70-b804-2d45f3896d54 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:12.908439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0372f-d8b8-4407-a15f-d698f266016f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:12.909195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0372f-d8b8-4407-a15f-d698f266016f admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:12.910203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0372f-d8b8-4407-a15f-d698f266016f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:12.910203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0372f-d8b8-4407-a15f-d698f266016f admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:12.910745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0372f-d8b8-4407-a15f-d698f266016f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:12.913382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0372f-d8b8-4407-a15f-d698f266016f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:12.945424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1151/2296] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:12 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:12.950314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33ef32-9edc-4203-a9dd-ecb3b947adfe admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:12.963685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33ef32-9edc-4203-a9dd-ecb3b947adfe admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:12.970041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:12.970850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:12.971338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:12.982683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:12.987922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:12.990588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:13.052906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1146/2297] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:13.059206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0372f-d8b8-4407-a15f-d698f266016f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:13.091349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0372f-d8b8-4407-a15f-d698f266016f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:13.103966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c382cab-1c20-4e79-b3bd-a64c3b52d02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:13.109125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382cab-1c20-4e79-b3bd-a64c3b52d02d admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:13.109582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382cab-1c20-4e79-b3bd-a64c3b52d02d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:13.109771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:13.109890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c382cab-1c20-4e79-b3bd-a64c3b52d02d admin admin] PATH_INFO: `/v3/projects/239c6f8ff9f8438ab3ed2ed76ec7434e/users/7153b53ad59f4636a57c976e8b901947/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:13.113050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:13.132520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d481c8-26cc-4461-b50d-c5071b5963da admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:13.138166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:13.161386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:13.162219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:13.162619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:13.163059 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] PATH_INFO: `/v3/users/3fe6bae714b543df81ee5f9f2663515f` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:13.163488 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c382cab-1c20-4e79-b3bd-a64c3b52d02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=239c6f8ff9f8438ab3ed2ed76ec7434e, user_id=7153b53ad59f4636a57c976e8b901947, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:13.166985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c382cab-1c20-4e79-b3bd-a64c3b52d02d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:13.168787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fe6bae714b543df81ee5f9f2663515f)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:13.171319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:13.207681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1152/2298] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:13 2022] PUT /identity/v3/projects/239c6f8ff9f8438ab3ed2ed76ec7434e/users/7153b53ad59f4636a57c976e8b901947/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:13.209093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c382cab-1c20-4e79-b3bd-a64c3b52d02d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:13.278043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fe6bae714b543df81ee5f9f2663515f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:13.279387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fe6bae714b543df81ee5f9f2663515f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:13.285533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:13.297807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fe6bae714b543df81ee5f9f2663515f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:13.329552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fe6bae714b543df81ee5f9f2663515f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:13.345374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-658b8c90-9799-45dd-9f68-862e979bd1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fe6bae714b543df81ee5f9f2663515f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:13.346444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c382cab-1c20-4e79-b3bd-a64c3b52d02d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:13.363653 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1147/2299] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:13 2022] DELETE /identity/v3/users/3fe6bae714b543df81ee5f9f2663515f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:13.364294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:13.364920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:13.365356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:13.365462 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:13.366421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:13.367799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:13.371256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684862f-24e6-4c59-a208-c943053ab2a9 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:13.371447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684862f-24e6-4c59-a208-c943053ab2a9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:13.371714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684862f-24e6-4c59-a208-c943053ab2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:13.393231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1153/2300] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:13.394478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:13.397707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:13.415844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5684862f-24e6-4c59-a208-c943053ab2a9 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:13.417169 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5684862f-24e6-4c59-a208-c943053ab2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:13.431790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a633d-96a9-490e-b76d-6d268337dba7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:13.535541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1148/2301] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:13.545467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684862f-24e6-4c59-a208-c943053ab2a9 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:13.547096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5684862f-24e6-4c59-a208-c943053ab2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:13.602199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:13.603592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:13.603885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:13.604191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] PATH_INFO: `/v3/projects/239c6f8ff9f8438ab3ed2ed76ec7434e/users/7153b53ad59f4636a57c976e8b901947/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:13.609971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239c6f8ff9f8438ab3ed2ed76ec7434e, user_id=7153b53ad59f4636a57c976e8b901947, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:13.613019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:13.631219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1154/2302] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:13 2022] PUT /identity/v3/projects/239c6f8ff9f8438ab3ed2ed76ec7434e/users/7153b53ad59f4636a57c976e8b901947/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:13.683135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684862f-24e6-4c59-a208-c943053ab2a9 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:13.694347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:13.696962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:13.751698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f888e740-8b06-42c7-8e43-30baee1f7aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:13.752431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e740-8b06-42c7-8e43-30baee1f7aca service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:13.752783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e740-8b06-42c7-8e43-30baee1f7aca service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:13.753129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f888e740-8b06-42c7-8e43-30baee1f7aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:13.875689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0b54-8a9c-4d9b-9156-bd1b2b26ddd8 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:13.892242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:13.893171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:13.894340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:13.894819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] PATH_INFO: `/v3/users/737df239c66241e8a5e1b47c34264754` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:13.900988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:13.906575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=737df239c66241e8a5e1b47c34264754)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:13.908625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:13.960024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e740-8b06-42c7-8e43-30baee1f7aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:13.971353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f888e740-8b06-42c7-8e43-30baee1f7aca service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:13.972063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:14.005974 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1149/2303] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:14.041380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737df239c66241e8a5e1b47c34264754'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:14.072229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737df239c66241e8a5e1b47c34264754'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:14.073359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737df239c66241e8a5e1b47c34264754'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:14.080710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737df239c66241e8a5e1b47c34264754'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:14.100020 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737df239c66241e8a5e1b47c34264754'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:14.129435 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1155/2304] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:13 2022] DELETE /identity/v3/users/737df239c66241e8a5e1b47c34264754 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:14.135800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b38b-07c2-464d-afd4-0e83c2524342 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:14.136249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b38b-07c2-464d-afd4-0e83c2524342 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:14.136583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6b38b-07c2-464d-afd4-0e83c2524342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:14.189190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8ed6b38b-07c2-464d-afd4-0e83c2524342 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:14.198512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8ed6b38b-07c2-464d-afd4-0e83c2524342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:14.393041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1150/2305] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:14.439341 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:14.441643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:14.614089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb23f7-9c50-4831-aac4-0a09a8bdbe8d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:14.624870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d2c33-8685-497b-97d0-0b0faff7c5cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:14.626064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d2c33-8685-497b-97d0-0b0faff7c5cc service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:14.626242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d2c33-8685-497b-97d0-0b0faff7c5cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:14.626518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d2c33-8685-497b-97d0-0b0faff7c5cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:14.651932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d2c33-8685-497b-97d0-0b0faff7c5cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:14.653364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d2c33-8685-497b-97d0-0b0faff7c5cc service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:14.682330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1156/2306] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:15.153956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6b38b-07c2-464d-afd4-0e83c2524342 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:15.154718 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8ed6b38b-07c2-464d-afd4-0e83c2524342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:15.183265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6b38b-07c2-464d-afd4-0e83c2524342 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:15.201517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:15.202115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:15.202921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:15.203210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] PATH_INFO: `/v3/projects/6024511fe5794891b987528938bd979d` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:15.206596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6024511fe5794891b987528938bd979d)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:15.211379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:15.338354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6024511fe5794891b987528938bd979d', 'request_id': 'req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.356724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6024511fe5794891b987528938bd979d', 'request_id': 'req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.365929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6024511fe5794891b987528938bd979d', 'request_id': 'req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.387572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] The token cache is being invalidate because project 6024511fe5794891b987528938bd979d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:15.387894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.388828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ab5bf54-a39f-4e71-bcf5-7441c7722e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.394003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1151/2307] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:15 2022] DELETE /identity/v3/projects/6024511fe5794891b987528938bd979d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:15.398870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270f69d-f52e-4eb0-8485-04fc18e6a38e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:15.399735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270f69d-f52e-4eb0-8485-04fc18e6a38e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:15.400022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270f69d-f52e-4eb0-8485-04fc18e6a38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:15.425814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c270f69d-f52e-4eb0-8485-04fc18e6a38e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:15.427472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c270f69d-f52e-4eb0-8485-04fc18e6a38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:15.587253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17616a-fb8c-4f6d-8210-9d45295ab3cb None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:15.587553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17616a-fb8c-4f6d-8210-9d45295ab3cb None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:15.587808 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17616a-fb8c-4f6d-8210-9d45295ab3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:15.588047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1157/2308] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:15.653733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4c17616a-fb8c-4f6d-8210-9d45295ab3cb None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:15.656895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4c17616a-fb8c-4f6d-8210-9d45295ab3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:15.677123 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270f69d-f52e-4eb0-8485-04fc18e6a38e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:15.679625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c270f69d-f52e-4eb0-8485-04fc18e6a38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:15.704505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1152/2309] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:15.705020 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270f69d-f52e-4eb0-8485-04fc18e6a38e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:15.708537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17616a-fb8c-4f6d-8210-9d45295ab3cb None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:15.710017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:15.710659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:15.710937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:15.711210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] PATH_INFO: `/v3/projects/c17e440dbe1a444e8abf135cb2350c68` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:15.712479 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17e440dbe1a444e8abf135cb2350c68)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:15.714726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:15.737020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17616a-fb8c-4f6d-8210-9d45295ab3cb None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:15.748989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:15.749622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:15.749906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:15.750185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:15.751019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:15.751331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:15.752995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:15.797358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1153/2310] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:15.798348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:15.807530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:15.821771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17e440dbe1a444e8abf135cb2350c68', 'request_id': 'req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.831265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efadc43-180f-4cb3-bff4-bc3c3188ea44 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:15.846670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17e440dbe1a444e8abf135cb2350c68', 'request_id': 'req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.857332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17e440dbe1a444e8abf135cb2350c68', 'request_id': 'req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.922097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:15.935518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] The token cache is being invalidate because project c17e440dbe1a444e8abf135cb2350c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:15.935518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.941770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:15.945899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1158/2311] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:15 2022] DELETE /identity/v3/projects/c17e440dbe1a444e8abf135cb2350c68 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:15.950359 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:15.953526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:15.972218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:15.973300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:15.973790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:15.974390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:15.975240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:15.978951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:16.046793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1154/2312] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:15 2022] POST /identity/v3/projects => generated 369 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:16.054747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:16.059546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:16.225761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59f1d3d-2b7a-48bc-a0ef-a4adc2fe4454 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:16.238337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:16.239414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:16.253724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30187142-9662-4443-b524-67dbd1e4710b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:16.254199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:16.254484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] PATH_INFO: `/v3/users/b220b96ff8dc4425b1b24f5bbcb8e5d2` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:16.257351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b220b96ff8dc4425b1b24f5bbcb8e5d2)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:16.260939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:16.267633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a018-7490-49e8-a844-ed3ef67993e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:16.269038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a018-7490-49e8-a844-ed3ef67993e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:16.269322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a018-7490-49e8-a844-ed3ef67993e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:16.271853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a018-7490-49e8-a844-ed3ef67993e5 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:16.273275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0a018-7490-49e8-a844-ed3ef67993e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:16.275663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0a018-7490-49e8-a844-ed3ef67993e5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:16.335902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1155/2313] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:16 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:16.338301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a018-7490-49e8-a844-ed3ef67993e5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:16.366078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a018-7490-49e8-a844-ed3ef67993e5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:16.379449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc1cad-e029-423a-a321-96585ded44c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:16.380510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1cad-e029-423a-a321-96585ded44c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:16.380770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1cad-e029-423a-a321-96585ded44c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:16.381242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc1cad-e029-423a-a321-96585ded44c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:16.385184 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc1cad-e029-423a-a321-96585ded44c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:16.389975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc1cad-e029-423a-a321-96585ded44c7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:16.405125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b220b96ff8dc4425b1b24f5bbcb8e5d2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:16.423949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1156/2314] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:16.425036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc1cad-e029-423a-a321-96585ded44c7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:16.443688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b220b96ff8dc4425b1b24f5bbcb8e5d2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:16.444552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b220b96ff8dc4425b1b24f5bbcb8e5d2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:16.445254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b220b96ff8dc4425b1b24f5bbcb8e5d2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:16.449107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc1cad-e029-423a-a321-96585ded44c7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:16.459605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:16.460269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:16.460564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:16.460820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:16.463549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:16.467765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:16.468409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-27f39f51-2368-4dc7-9e07-09dbc7a646d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b220b96ff8dc4425b1b24f5bbcb8e5d2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:16.496793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1157/2315] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:16.500859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1159/2316] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:15 2022] DELETE /identity/v3/users/b220b96ff8dc4425b1b24f5bbcb8e5d2 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:16.504958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:16.510930 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:16.550254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3dc98-24ac-423d-a4aa-cd7ff5667ff4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:16.628200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e3a8-98b1-4b22-8844-2b0aeebed5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:16.628842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e3a8-98b1-4b22-8844-2b0aeebed5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:16.629123 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e3a8-98b1-4b22-8844-2b0aeebed5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:16.629399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789e3a8-98b1-4b22-8844-2b0aeebed5a4 admin admin] PATH_INFO: `/v3/projects/9c9b1cec11ff4441aec56c563c2571d7/users/65010400f448492d9fd8b3a893884b75/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:16.649056 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789e3a8-98b1-4b22-8844-2b0aeebed5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9b1cec11ff4441aec56c563c2571d7, user_id=65010400f448492d9fd8b3a893884b75, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:16.651796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789e3a8-98b1-4b22-8844-2b0aeebed5a4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:16.676947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1158/2317] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:16 2022] PUT /identity/v3/projects/9c9b1cec11ff4441aec56c563c2571d7/users/65010400f448492d9fd8b3a893884b75/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:16.690530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368af1-dbea-49bd-882a-184bb4093a78 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:16.691520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368af1-dbea-49bd-882a-184bb4093a78 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:16.692626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9368af1-dbea-49bd-882a-184bb4093a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:16.738266 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c9368af1-dbea-49bd-882a-184bb4093a78 None None] MFA Rules not processed for user `65010400f448492d9fd8b3a893884b75`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:16.740032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c9368af1-dbea-49bd-882a-184bb4093a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:16.801066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:16.870835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1160/2318] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:16.875596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e3a8-98b1-4b22-8844-2b0aeebed5a4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:16.903910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:16.981748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789e3a8-98b1-4b22-8844-2b0aeebed5a4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:16.988324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792fa77-c545-480b-a6aa-8b7370428da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:16.989229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792fa77-c545-480b-a6aa-8b7370428da6 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:16.989612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792fa77-c545-480b-a6aa-8b7370428da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:16.989990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792fa77-c545-480b-a6aa-8b7370428da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:16.990890 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792fa77-c545-480b-a6aa-8b7370428da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:16.993046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792fa77-c545-480b-a6aa-8b7370428da6 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:17.045410 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368af1-dbea-49bd-882a-184bb4093a78 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:17.051776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1159/2319] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:16 2022] POST /identity/v3/projects => generated 369 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:17.071149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9368af1-dbea-49bd-882a-184bb4093a78 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:17.188159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc81ac-c90b-442d-8ddb-1dd7bdef0702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:17.189340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc81ac-c90b-442d-8ddb-1dd7bdef0702 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:17.189630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc81ac-c90b-442d-8ddb-1dd7bdef0702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:17.190671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc81ac-c90b-442d-8ddb-1dd7bdef0702 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:17.191983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc81ac-c90b-442d-8ddb-1dd7bdef0702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:17.203480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc81ac-c90b-442d-8ddb-1dd7bdef0702 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:17.245814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1161/2320] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:17 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:17.249717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792fa77-c545-480b-a6aa-8b7370428da6 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:17.270385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792fa77-c545-480b-a6aa-8b7370428da6 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:17.278955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d2ba3-fd2a-4fda-81bb-6063092c84ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:17.280414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2ba3-fd2a-4fda-81bb-6063092c84ac admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:17.280908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2ba3-fd2a-4fda-81bb-6063092c84ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:17.281704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d2ba3-fd2a-4fda-81bb-6063092c84ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:17.282869 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d2ba3-fd2a-4fda-81bb-6063092c84ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:17.285394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d2ba3-fd2a-4fda-81bb-6063092c84ac admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:17.313535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc81ac-c90b-442d-8ddb-1dd7bdef0702 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:17.316704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1160/2321] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:17.331677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc81ac-c90b-442d-8ddb-1dd7bdef0702 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:17.360118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b279-fbfa-4abe-84d0-8e8c420d0d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:17.360899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b279-fbfa-4abe-84d0-8e8c420d0d9d admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:17.361186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b279-fbfa-4abe-84d0-8e8c420d0d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:17.361475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3b279-fbfa-4abe-84d0-8e8c420d0d9d admin admin] PATH_INFO: `/v3/projects/f1f86e7d90964d709f7c4eefe28b3f63/users/257d56868fe14e42bc9b7e5150266c43/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:17.400685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b279-fbfa-4abe-84d0-8e8c420d0d9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f86e7d90964d709f7c4eefe28b3f63, user_id=257d56868fe14e42bc9b7e5150266c43, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:17.409627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3b279-fbfa-4abe-84d0-8e8c420d0d9d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:17.444461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1162/2322] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:17 2022] PUT /identity/v3/projects/f1f86e7d90964d709f7c4eefe28b3f63/users/257d56868fe14e42bc9b7e5150266c43/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:17.449022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d2ba3-fd2a-4fda-81bb-6063092c84ac admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:17.469301 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d2ba3-fd2a-4fda-81bb-6063092c84ac admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:17.619444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4de61-6a61-4876-86ae-187faaf3c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:17.620089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4de61-6a61-4876-86ae-187faaf3c5ac admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:17.620401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4de61-6a61-4876-86ae-187faaf3c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:17.620679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4de61-6a61-4876-86ae-187faaf3c5ac admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:17.621333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4de61-6a61-4876-86ae-187faaf3c5ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:17.623002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4de61-6a61-4876-86ae-187faaf3c5ac admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:17.662933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1161/2323] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:17.670571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b279-fbfa-4abe-84d0-8e8c420d0d9d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:17.686161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3b279-fbfa-4abe-84d0-8e8c420d0d9d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:17.693845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:17.698866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:17.699161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:17.699435 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] PATH_INFO: `/v3/projects/f1f86e7d90964d709f7c4eefe28b3f63/users/257d56868fe14e42bc9b7e5150266c43/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:17.703517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f86e7d90964d709f7c4eefe28b3f63, user_id=257d56868fe14e42bc9b7e5150266c43, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:17.709433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:17.742117 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1163/2324] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:17 2022] PUT /identity/v3/projects/f1f86e7d90964d709f7c4eefe28b3f63/users/257d56868fe14e42bc9b7e5150266c43/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:17.752909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2acb-fac6-44cd-8fe4-c55fa4b776fa None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:17.754072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2acb-fac6-44cd-8fe4-c55fa4b776fa None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:17.754885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b2acb-fac6-44cd-8fe4-c55fa4b776fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:17.815150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-fa4b2acb-fac6-44cd-8fe4-c55fa4b776fa None None] MFA Rules not processed for user `257d56868fe14e42bc9b7e5150266c43`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:17.818400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fa4b2acb-fac6-44cd-8fe4-c55fa4b776fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:17.970066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:17.973296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:18.019114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1162/2325] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:18.049030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2acb-fac6-44cd-8fe4-c55fa4b776fa None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:18.052487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fa4b2acb-fac6-44cd-8fe4-c55fa4b776fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:18.109150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:18.219387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709874-5ffd-4b9c-99f2-0b5cce08fcd2 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:18.233201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:18.235257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:18.235544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:18.235819 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] PATH_INFO: `/v3/projects/7545519d58b14100ae5f29411277851d` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:18.244623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=7545519d58b14100ae5f29411277851d)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:18.248310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:18.272097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b2acb-fac6-44cd-8fe4-c55fa4b776fa None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:18.287126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dea51e-e2ff-4f87-ba5e-f16e2fbd3fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:18.292216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dea51e-e2ff-4f87-ba5e-f16e2fbd3fdd service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:18.292452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dea51e-e2ff-4f87-ba5e-f16e2fbd3fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:18.292727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dea51e-e2ff-4f87-ba5e-f16e2fbd3fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:18.322047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dea51e-e2ff-4f87-ba5e-f16e2fbd3fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:18.323841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dea51e-e2ff-4f87-ba5e-f16e2fbd3fdd service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:18.363960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1163/2326] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:18.368306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:18.419100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7545519d58b14100ae5f29411277851d', 'request_id': 'req-ec3be606-0621-4eef-957b-11adbf4872aa'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.442310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7545519d58b14100ae5f29411277851d', 'request_id': 'req-ec3be606-0621-4eef-957b-11adbf4872aa'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.460890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7545519d58b14100ae5f29411277851d', 'request_id': 'req-ec3be606-0621-4eef-957b-11adbf4872aa'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.499231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] The token cache is being invalidate because project 7545519d58b14100ae5f29411277851d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:18.499585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.500457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ec3be606-0621-4eef-957b-11adbf4872aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.502829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1164/2327] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:17 2022] DELETE /identity/v3/projects/7545519d58b14100ae5f29411277851d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:18.507324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dea51e-e2ff-4f87-ba5e-f16e2fbd3fdd service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:18.544226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dea51e-e2ff-4f87-ba5e-f16e2fbd3fdd service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:18.631144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:18.631789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:18.632103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:18.633096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] PATH_INFO: `/v3/users/53883f331ef94d5a8993618a41cf38cd` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:18.634506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53883f331ef94d5a8993618a41cf38cd)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:18.636816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:18.757431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53883f331ef94d5a8993618a41cf38cd'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.758424 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53883f331ef94d5a8993618a41cf38cd'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.776243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53883f331ef94d5a8993618a41cf38cd'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.795622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53883f331ef94d5a8993618a41cf38cd'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.805047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53883f331ef94d5a8993618a41cf38cd'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:18.820773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1164/2328] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:18 2022] DELETE /identity/v3/users/53883f331ef94d5a8993618a41cf38cd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:18.950371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb0ecc-f0fe-4e9f-9d55-522545915baa None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:18.950929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb0ecc-f0fe-4e9f-9d55-522545915baa None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:18.951170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb0ecc-f0fe-4e9f-9d55-522545915baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:19.021329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-53cb0ecc-f0fe-4e9f-9d55-522545915baa None None] MFA Rules not processed for user `63e782a27e764b1ca9302094f788815f`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:19.022816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-53cb0ecc-f0fe-4e9f-9d55-522545915baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:19.246210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1165/2329] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:19.248870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:19.251951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:19.314381 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:19.369831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a392520-2638-44ae-ae58-19d2f42d2dc1 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:19.382724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203d788-e0be-4ae1-a905-9857e4ed8039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:19.384085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203d788-e0be-4ae1-a905-9857e4ed8039 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:19.384571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203d788-e0be-4ae1-a905-9857e4ed8039 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:19.387729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7203d788-e0be-4ae1-a905-9857e4ed8039 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:19.391447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203d788-e0be-4ae1-a905-9857e4ed8039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:19.393998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7203d788-e0be-4ae1-a905-9857e4ed8039 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:19.433677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1165/2330] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:19 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:19.437745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb0ecc-f0fe-4e9f-9d55-522545915baa None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:19.459902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb0ecc-f0fe-4e9f-9d55-522545915baa None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:19.650014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60045a-781c-434e-b806-697e22bda1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:19.651267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60045a-781c-434e-b806-697e22bda1fc admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:19.651785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60045a-781c-434e-b806-697e22bda1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:19.653295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c60045a-781c-434e-b806-697e22bda1fc admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:19.654158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60045a-781c-434e-b806-697e22bda1fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:19.659957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c60045a-781c-434e-b806-697e22bda1fc admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:19.758406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1166/2331] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:19 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:19.763438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203d788-e0be-4ae1-a905-9857e4ed8039 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:19.800525 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7203d788-e0be-4ae1-a905-9857e4ed8039 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:19.830369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:19.831002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:19.831290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:19.831571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:19.832353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:19.847944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:19.893785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1166/2332] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:19.896323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60045a-781c-434e-b806-697e22bda1fc admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:19.953195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:19.955246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:19.960079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c60045a-781c-434e-b806-697e22bda1fc admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:19.982893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2784ce0-4adc-4697-bfbd-50d4396290d9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:19.991002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:19.991002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:19.991002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:19.991002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] PATH_INFO: `/v3/projects/5e83169dbd7a4c7b8faa508d72973de0` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:20.007091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f66236-0af7-4a9f-b675-7c5b281cabe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:20.007932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f66236-0af7-4a9f-b675-7c5b281cabe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:20.008432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f66236-0af7-4a9f-b675-7c5b281cabe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:20.008744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e83169dbd7a4c7b8faa508d72973de0)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:20.009144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f66236-0af7-4a9f-b675-7c5b281cabe5 admin admin] PATH_INFO: `/v3/projects/cbb1dc61f7f84f7192767dc11b6cf9d3/users/65fae5d506444eac8336b78d87d6fd51/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:20.010942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:20.053610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f66236-0af7-4a9f-b675-7c5b281cabe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb1dc61f7f84f7192767dc11b6cf9d3, user_id=65fae5d506444eac8336b78d87d6fd51, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:20.057875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f66236-0af7-4a9f-b675-7c5b281cabe5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:20.121695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1167/2333] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:19 2022] PUT /identity/v3/projects/cbb1dc61f7f84f7192767dc11b6cf9d3/users/65fae5d506444eac8336b78d87d6fd51/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:20.123087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f66236-0af7-4a9f-b675-7c5b281cabe5 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:20.187445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:20.225615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e83169dbd7a4c7b8faa508d72973de0', 'request_id': 'req-3d6cd0a0-23db-4212-973d-f09c05103487'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:20.257322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e83169dbd7a4c7b8faa508d72973de0', 'request_id': 'req-3d6cd0a0-23db-4212-973d-f09c05103487'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:20.270737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e83169dbd7a4c7b8faa508d72973de0', 'request_id': 'req-3d6cd0a0-23db-4212-973d-f09c05103487'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:20.304304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] The token cache is being invalidate because project 5e83169dbd7a4c7b8faa508d72973de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:20.304603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:20.309257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3d6cd0a0-23db-4212-973d-f09c05103487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:20.314881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1167/2334] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:19 2022] DELETE /identity/v3/projects/5e83169dbd7a4c7b8faa508d72973de0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:20.323242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e3c34-e061-4e3b-879b-ea6d15fc49d6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:20.325445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e3c34-e061-4e3b-879b-ea6d15fc49d6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:20.325880 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e3c34-e061-4e3b-879b-ea6d15fc49d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:20.368292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f66236-0af7-4a9f-b675-7c5b281cabe5 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:20.377103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2b2e3c34-e061-4e3b-879b-ea6d15fc49d6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:20.378426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2b2e3c34-e061-4e3b-879b-ea6d15fc49d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:20.492705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:20.494732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:20.495273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:20.496430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:20.497316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:20.502186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:20.503663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1168/2335] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:20.517078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0384-ae9f-458f-b79a-66e0f3ea7757 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:20.517384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0384-ae9f-458f-b79a-66e0f3ea7757 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:20.517696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a0384-ae9f-458f-b79a-66e0f3ea7757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:20.536356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1168/2336] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:20.543643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:20.559227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:20.579978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-175a0384-ae9f-458f-b79a-66e0f3ea7757 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:20.582590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-175a0384-ae9f-458f-b79a-66e0f3ea7757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:20.584994 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58773861-e176-4b62-bb2d-69e5b7ab8e06 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:20.602329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133bb7a-123d-4857-a405-3a30683fb204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:20.603228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133bb7a-123d-4857-a405-3a30683fb204 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:20.603582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133bb7a-123d-4857-a405-3a30683fb204 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:20.603865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133bb7a-123d-4857-a405-3a30683fb204 admin admin] PATH_INFO: `/v3/projects/cbb1dc61f7f84f7192767dc11b6cf9d3/users/65fae5d506444eac8336b78d87d6fd51/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:20.609937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133bb7a-123d-4857-a405-3a30683fb204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb1dc61f7f84f7192767dc11b6cf9d3, user_id=65fae5d506444eac8336b78d87d6fd51, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:20.613921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133bb7a-123d-4857-a405-3a30683fb204 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:20.626781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1169/2337] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:20.630271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0384-ae9f-458f-b79a-66e0f3ea7757 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:20.651966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1169/2338] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:20 2022] PUT /identity/v3/projects/cbb1dc61f7f84f7192767dc11b6cf9d3/users/65fae5d506444eac8336b78d87d6fd51/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:20.668777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a0384-ae9f-458f-b79a-66e0f3ea7757 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:20.732869 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:20.789601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:20.791625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:20.791960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:20.792282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:20.793090 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:20.793823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:20.796945 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:20.814403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1170/2339] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:20.819695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133bb7a-123d-4857-a405-3a30683fb204 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:20.834993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133bb7a-123d-4857-a405-3a30683fb204 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:20.841656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30312e1-341b-43c3-9a8f-c0dbd15e6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:20.842541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30312e1-341b-43c3-9a8f-c0dbd15e6e30 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:20.845874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30312e1-341b-43c3-9a8f-c0dbd15e6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:20.845874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30312e1-341b-43c3-9a8f-c0dbd15e6e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:20.845874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30312e1-341b-43c3-9a8f-c0dbd15e6e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:20.846535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30312e1-341b-43c3-9a8f-c0dbd15e6e30 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:20.889484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1170/2340] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:20 2022] POST /identity/v3/projects => generated 359 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:20.893115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:20.907155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e9742-0fcc-4a9b-8547-9ddb5df647bf admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:21.208952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae1ce5-2f0d-486c-8559-c33ff9b607ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:21.209649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae1ce5-2f0d-486c-8559-c33ff9b607ec admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:21.209871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae1ce5-2f0d-486c-8559-c33ff9b607ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:21.210597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ae1ce5-2f0d-486c-8559-c33ff9b607ec admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:21.210818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae1ce5-2f0d-486c-8559-c33ff9b607ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:21.218476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ae1ce5-2f0d-486c-8559-c33ff9b607ec admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:21.301239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1171/2341] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:20 2022] POST /identity/v3/users => generated 280 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:21.306347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30312e1-341b-43c3-9a8f-c0dbd15e6e30 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:21.324890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30312e1-341b-43c3-9a8f-c0dbd15e6e30 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:21.340205 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b84af5-b05b-446d-8c0b-2bee645b4744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:21.340851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b84af5-b05b-446d-8c0b-2bee645b4744 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:21.341132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b84af5-b05b-446d-8c0b-2bee645b4744 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:21.341405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b84af5-b05b-446d-8c0b-2bee645b4744 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:21.342047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b84af5-b05b-446d-8c0b-2bee645b4744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:21.348620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b84af5-b05b-446d-8c0b-2bee645b4744 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:21.406781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1171/2342] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:21.411495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae1ce5-2f0d-486c-8559-c33ff9b607ec admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:21.437931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ae1ce5-2f0d-486c-8559-c33ff9b607ec admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:21.453415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c970e7cb-2318-4a15-86c3-dc7e385831ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:21.454226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970e7cb-2318-4a15-86c3-dc7e385831ee admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:21.454660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970e7cb-2318-4a15-86c3-dc7e385831ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:21.455083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c970e7cb-2318-4a15-86c3-dc7e385831ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:21.455887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970e7cb-2318-4a15-86c3-dc7e385831ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:21.461904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c970e7cb-2318-4a15-86c3-dc7e385831ee admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:21.498221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1172/2343] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:21.502345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b84af5-b05b-446d-8c0b-2bee645b4744 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:21.524785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b84af5-b05b-446d-8c0b-2bee645b4744 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:21.554916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:21.556665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:21.560768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:21.561482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] PATH_INFO: `/v3/projects/2a5cc0e5882e4c4f8f6197b2634ae591/users/0a1873465d174fad80bdd33b09017cb3/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:21.594898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a5cc0e5882e4c4f8f6197b2634ae591, user_id=0a1873465d174fad80bdd33b09017cb3, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:21.601468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:21.639150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1172/2344] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:21 2022] PUT /identity/v3/projects/2a5cc0e5882e4c4f8f6197b2634ae591/users/0a1873465d174fad80bdd33b09017cb3/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:21.652411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035d5f-b060-4de6-b154-a343faa19279 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:21.652700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035d5f-b060-4de6-b154-a343faa19279 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:21.653035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035d5f-b060-4de6-b154-a343faa19279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:21.701950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e6035d5f-b060-4de6-b154-a343faa19279 None None] MFA Rules not processed for user `0a1873465d174fad80bdd33b09017cb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:21.703275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e6035d5f-b060-4de6-b154-a343faa19279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:21.860481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1173/2345] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:21.991151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:21.997499 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:22.109432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:22.117427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b7ca5-468d-4088-b189-56459c7da3ba admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:22.123605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:22.124679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:22.125092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:22.125894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:22.142517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:22.144515 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:22.170632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1173/2346] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:22.188739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6035d5f-b060-4de6-b154-a343faa19279 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:22.232502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:22.233965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:22.238430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:22.310170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6035d5f-b060-4de6-b154-a343faa19279 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:22.319864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:22.321843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:22.322561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:22.323093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] PATH_INFO: `/v3/users/0a1873465d174fad80bdd33b09017cb3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:22.327748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1873465d174fad80bdd33b09017cb3)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:22.330269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:22.406195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8b41-79c2-4473-acd6-872abfedbf93 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:22.419631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1873465d174fad80bdd33b09017cb3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.422306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1873465d174fad80bdd33b09017cb3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.423792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:22.424569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:22.425056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:22.425408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] PATH_INFO: `/v3/users/65010400f448492d9fd8b3a893884b75` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:22.427603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65010400f448492d9fd8b3a893884b75)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:22.435681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:22.440799 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1873465d174fad80bdd33b09017cb3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.486392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1873465d174fad80bdd33b09017cb3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.508452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4d904450-34be-4084-b5dd-1ba6c7c62f89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1873465d174fad80bdd33b09017cb3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.524819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1174/2347] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:22 2022] DELETE /identity/v3/users/0a1873465d174fad80bdd33b09017cb3 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:22.529617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e508a-3f35-453c-8d55-8ba2c180f131 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:22.530304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e508a-3f35-453c-8d55-8ba2c180f131 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:22.530816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e508a-3f35-453c-8d55-8ba2c180f131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:22.533193 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65010400f448492d9fd8b3a893884b75'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.557457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65010400f448492d9fd8b3a893884b75'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.558586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65010400f448492d9fd8b3a893884b75'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.562844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65010400f448492d9fd8b3a893884b75'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.620853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-719e508a-3f35-453c-8d55-8ba2c180f131 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:22.625378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ca78b3ba-5a1d-4883-979e-ca1d63da3762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65010400f448492d9fd8b3a893884b75'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:22.626215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-719e508a-3f35-453c-8d55-8ba2c180f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:22.756811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1174/2348] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:22 2022] DELETE /identity/v3/users/65010400f448492d9fd8b3a893884b75 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:22.761470 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08f0a-460b-4ac4-bced-7ee007af73e8 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:22.762310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08f0a-460b-4ac4-bced-7ee007af73e8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:22.763866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b08f0a-460b-4ac4-bced-7ee007af73e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:22.787249 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1175/2349] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:22.800216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e508a-3f35-453c-8d55-8ba2c180f131 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:22.802293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-719e508a-3f35-453c-8d55-8ba2c180f131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:22.821893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b0b08f0a-460b-4ac4-bced-7ee007af73e8 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:22.823305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b0b08f0a-460b-4ac4-bced-7ee007af73e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:22.950362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:22.960092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e508a-3f35-453c-8d55-8ba2c180f131 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:22.986436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1175/2350] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:22.997451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b08f0a-460b-4ac4-bced-7ee007af73e8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:23.013830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:23.105513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b285533-1710-4adc-823c-c6f4efec95ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:23.107766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285533-1710-4adc-823c-c6f4efec95ab service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:23.109260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285533-1710-4adc-823c-c6f4efec95ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:23.109574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b285533-1710-4adc-823c-c6f4efec95ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:23.154886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b285533-1710-4adc-823c-c6f4efec95ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:23.156286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b08f0a-460b-4ac4-bced-7ee007af73e8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:23.156417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b285533-1710-4adc-823c-c6f4efec95ab service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:23.187002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:23.187827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:23.193280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:23.196999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:23.200469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1176/2351] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:23.225953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:23.228837 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:23.261086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1176/2352] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:47:24.161866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909247a7-4098-475b-85ce-7a7fbd87d84e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:24.162431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909247a7-4098-475b-85ce-7a7fbd87d84e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:24.162431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909247a7-4098-475b-85ce-7a7fbd87d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:24.205962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-909247a7-4098-475b-85ce-7a7fbd87d84e None None] MFA Rules not processed for user `7153b53ad59f4636a57c976e8b901947`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:24.207207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-909247a7-4098-475b-85ce-7a7fbd87d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:24.208157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:24.209554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:24.238350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a31f7de-6141-44f5-a368-e6d32b746bba service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:24.264881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:24.265523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:24.265805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:24.266080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] PATH_INFO: `/v3/projects/9c9b1cec11ff4441aec56c563c2571d7` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:24.278928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9b1cec11ff4441aec56c563c2571d7)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:24.285710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:24.360850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1177/2353] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:24 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:24.367115 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909247a7-4098-475b-85ce-7a7fbd87d84e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:24.369619 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-909247a7-4098-475b-85ce-7a7fbd87d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:24.480776 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9b1cec11ff4441aec56c563c2571d7', 'request_id': 'req-503416c9-7a6f-4a66-9ff2-49d4c38239df'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:24.499554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9b1cec11ff4441aec56c563c2571d7', 'request_id': 'req-503416c9-7a6f-4a66-9ff2-49d4c38239df'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:24.509051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909247a7-4098-475b-85ce-7a7fbd87d84e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:24.519544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9b1cec11ff4441aec56c563c2571d7', 'request_id': 'req-503416c9-7a6f-4a66-9ff2-49d4c38239df'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:24.558237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] The token cache is being invalidate because project 9c9b1cec11ff4441aec56c563c2571d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:24.558621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:24.559314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:24.564278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1177/2354] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:24 2022] DELETE /identity/v3/projects/9c9b1cec11ff4441aec56c563c2571d7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:24.564278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:24.571820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:24.600405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:24.617977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c0bf4de3a1442c8b856efbfac436fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:24.618394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:24.618749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:24.619035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:24.624923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:24.781791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503416c9-7a6f-4a66-9ff2-49d4c38239df admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:24.793921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:24.795387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:24.811487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:24.812632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:24.813754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:24.814659 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] PATH_INFO: `/v3/projects/2a5cc0e5882e4c4f8f6197b2634ae591` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:24.818111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a5cc0e5882e4c4f8f6197b2634ae591)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:24.818291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1178/2355] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:47:24.819746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:24.822306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:24.822787 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:24.868572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184723f-34d0-4ede-a2d1-1d41b054468f service glance] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:24.885504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:24.886168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:24.886455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:24.886739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] PATH_INFO: `/v3/users/257d56868fe14e42bc9b7e5150266c43` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:24.894137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=257d56868fe14e42bc9b7e5150266c43)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:24.904655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:24.911904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:24.935888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a5cc0e5882e4c4f8f6197b2634ae591', 'request_id': 'req-45da168d-32d9-43ae-aaec-6fbe2c27b150'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:24.955472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a5cc0e5882e4c4f8f6197b2634ae591', 'request_id': 'req-45da168d-32d9-43ae-aaec-6fbe2c27b150'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:24.980121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a5cc0e5882e4c4f8f6197b2634ae591', 'request_id': 'req-45da168d-32d9-43ae-aaec-6fbe2c27b150'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:25.022726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] The token cache is being invalidate because project 2a5cc0e5882e4c4f8f6197b2634ae591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:25.023255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:25.025548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-45da168d-32d9-43ae-aaec-6fbe2c27b150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:25.029239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1178/2356] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:24 2022] DELETE /identity/v3/projects/2a5cc0e5882e4c4f8f6197b2634ae591 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:25.037102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '257d56868fe14e42bc9b7e5150266c43'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:25.038959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40e0a2-3382-4f6c-9f40-fc6e5217298d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:25.039280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40e0a2-3382-4f6c-9f40-fc6e5217298d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:25.039558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40e0a2-3382-4f6c-9f40-fc6e5217298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:25.040009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '257d56868fe14e42bc9b7e5150266c43'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:25.074453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '257d56868fe14e42bc9b7e5150266c43'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:25.102740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '257d56868fe14e42bc9b7e5150266c43'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:25.118268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-bd40e0a2-3382-4f6c-9f40-fc6e5217298d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:25.127211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bd40e0a2-3382-4f6c-9f40-fc6e5217298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:25.132766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-191e39e4-20ce-44ee-98b4-8baaf45c83ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '257d56868fe14e42bc9b7e5150266c43'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:25.165391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1179/2357] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:24 2022] DELETE /identity/v3/users/257d56868fe14e42bc9b7e5150266c43 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:25.268487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7b0e-5f6b-48b8-bc2c-f0f492fb1026 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:25.268788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7b0e-5f6b-48b8-bc2c-f0f492fb1026 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:25.269050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf7b0e-5f6b-48b8-bc2c-f0f492fb1026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:25.329632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1179/2358] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:25.338245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ddaf7b0e-5f6b-48b8-bc2c-f0f492fb1026 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:25.339483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ddaf7b0e-5f6b-48b8-bc2c-f0f492fb1026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:25.340189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a3f03-a1ce-4b97-89ad-d531c0779391 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:25.341469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a3f03-a1ce-4b97-89ad-d531c0779391 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:25.341756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a3f03-a1ce-4b97-89ad-d531c0779391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:25.432775 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0e2a3f03-a1ce-4b97-89ad-d531c0779391 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:25.434135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0e2a3f03-a1ce-4b97-89ad-d531c0779391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:25.480259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1180/2359] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:47:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 31 09:47:25.568102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf7b0e-5f6b-48b8-bc2c-f0f492fb1026 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:25.569781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ddaf7b0e-5f6b-48b8-bc2c-f0f492fb1026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:25.629505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1180/2360] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:25.633965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a3f03-a1ce-4b97-89ad-d531c0779391 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:25.655654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:25.656280 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a3f03-a1ce-4b97-89ad-d531c0779391 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:25.672504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:25.673376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:25.673796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:25.674232 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:25.675049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:25.675496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:25.677976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:25.693380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1181/2361] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:47:25.698506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:25.713108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1cdfc-e776-4630-bc76-47e29e3e57a5 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:25.728685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6aecf-1a35-4985-af73-849654645312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:25.729519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6aecf-1a35-4985-af73-849654645312 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:25.730164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6aecf-1a35-4985-af73-849654645312 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:25.730575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6aecf-1a35-4985-af73-849654645312 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:25.732050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6aecf-1a35-4985-af73-849654645312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:25.735012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6aecf-1a35-4985-af73-849654645312 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:25.753180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaf7b0e-5f6b-48b8-bc2c-f0f492fb1026 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:25.759881 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c9f0-2fe5-4e19-81b9-799b84668505 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:25.761743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c9f0-2fe5-4e19-81b9-799b84668505 service swift] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:25.762422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c9f0-2fe5-4e19-81b9-799b84668505 service swift] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:25.763170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6c9f0-2fe5-4e19-81b9-799b84668505 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:25.783446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6c9f0-2fe5-4e19-81b9-799b84668505 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:25.785385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6c9f0-2fe5-4e19-81b9-799b84668505 service swift] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:25.804225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1182/2362] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:25 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:47:25.808553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6aecf-1a35-4985-af73-849654645312 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:25.810342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1181/2363] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:47:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 09:47:25.969838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:26.083562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6aecf-1a35-4985-af73-849654645312 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:26.091140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d4cc1-8150-4923-b062-6eb70decffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:26.092692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4cc1-8150-4923-b062-6eb70decffda admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:26.093070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4cc1-8150-4923-b062-6eb70decffda admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:26.093422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d4cc1-8150-4923-b062-6eb70decffda admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:26.094254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d4cc1-8150-4923-b062-6eb70decffda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:26.096742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d4cc1-8150-4923-b062-6eb70decffda admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:26.157491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1183/2364] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:25 2022] POST /identity/v3/users => generated 292 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:26.161337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c9f0-2fe5-4e19-81b9-799b84668505 service swift] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:26.186554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6c9f0-2fe5-4e19-81b9-799b84668505 service swift] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:26.199660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a996-c408-40f2-9206-1c49a305e8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:26.199917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a996-c408-40f2-9206-1c49a305e8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:26.200046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a996-c408-40f2-9206-1c49a305e8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:26.200356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690a996-c408-40f2-9206-1c49a305e8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:26.201006 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a996-c408-40f2-9206-1c49a305e8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:26.202761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690a996-c408-40f2-9206-1c49a305e8e7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:26.238716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d4cc1-8150-4923-b062-6eb70decffda admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:26.238957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1182/2365] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:26.254913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d4cc1-8150-4923-b062-6eb70decffda admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:26.270760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ab85c-b822-478b-b2c6-38555841768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:26.271660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab85c-b822-478b-b2c6-38555841768b admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:26.272096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab85c-b822-478b-b2c6-38555841768b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:26.272579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ab85c-b822-478b-b2c6-38555841768b admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:26.273396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ab85c-b822-478b-b2c6-38555841768b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:26.275347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ab85c-b822-478b-b2c6-38555841768b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:26.300183 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1184/2366] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:26.304537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a996-c408-40f2-9206-1c49a305e8e7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:26.320501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690a996-c408-40f2-9206-1c49a305e8e7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:26.345385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:26.346101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:26.351209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:26.351602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] PATH_INFO: `/v3/projects/ac57a3a9881642b990e10504e84d9cd2/users/17c8209074544082a26183b7d8e122f6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:26.398920 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac57a3a9881642b990e10504e84d9cd2, user_id=17c8209074544082a26183b7d8e122f6, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:26.401894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:26.439246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1183/2367] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:26 2022] PUT /identity/v3/projects/ac57a3a9881642b990e10504e84d9cd2/users/17c8209074544082a26183b7d8e122f6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:26.443973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2983-c2f7-4128-b359-ea4db43d1f8c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:26.445174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2983-c2f7-4128-b359-ea4db43d1f8c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:26.445698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a2983-c2f7-4128-b359-ea4db43d1f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:26.477894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-085a2983-c2f7-4128-b359-ea4db43d1f8c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:26.490424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-085a2983-c2f7-4128-b359-ea4db43d1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:26.633270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1185/2368] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:26.641137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:26.642988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:26.778242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2604ba-90fa-496a-8908-303dfbd351b1 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:26.786125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af523b-8ddb-474e-9451-7f2d6399b649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:26.786903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af523b-8ddb-474e-9451-7f2d6399b649 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:26.787291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af523b-8ddb-474e-9451-7f2d6399b649 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:26.787669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af523b-8ddb-474e-9451-7f2d6399b649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:26.811225 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a2983-c2f7-4128-b359-ea4db43d1f8c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:26.812950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-085a2983-c2f7-4128-b359-ea4db43d1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:26.817186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af523b-8ddb-474e-9451-7f2d6399b649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:26.826378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af523b-8ddb-474e-9451-7f2d6399b649 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:26.839197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a2983-c2f7-4128-b359-ea4db43d1f8c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:26.868986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:26.871644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:26.872145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1184/2369] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:26.872636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:26.873017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] PATH_INFO: `/v3/projects/f1f86e7d90964d709f7c4eefe28b3f63` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:26.888483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f86e7d90964d709f7c4eefe28b3f63)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:26.888483 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:27.032887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f86e7d90964d709f7c4eefe28b3f63', 'request_id': 'req-882f7f02-4083-4dca-bfdf-a389b07258db'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:27.051574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f86e7d90964d709f7c4eefe28b3f63', 'request_id': 'req-882f7f02-4083-4dca-bfdf-a389b07258db'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:27.060021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f86e7d90964d709f7c4eefe28b3f63', 'request_id': 'req-882f7f02-4083-4dca-bfdf-a389b07258db'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:27.083372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] The token cache is being invalidate because project f1f86e7d90964d709f7c4eefe28b3f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:27.083742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:27.092371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-882f7f02-4083-4dca-bfdf-a389b07258db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:27.098003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1186/2370] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:26 2022] DELETE /identity/v3/projects/f1f86e7d90964d709f7c4eefe28b3f63 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:27.100186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2698-f46b-402a-bfb8-d8fbedb846c2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:27.100186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2698-f46b-402a-bfb8-d8fbedb846c2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:27.100894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c2698-f46b-402a-bfb8-d8fbedb846c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:27.143155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-241c2698-f46b-402a-bfb8-d8fbedb846c2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:27.145051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-241c2698-f46b-402a-bfb8-d8fbedb846c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:27.292370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1185/2371] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:27.301415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d657-289d-44d3-bd62-43a74084ea61 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:27.301797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d657-289d-44d3-bd62-43a74084ea61 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:27.302182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e7d657-289d-44d3-bd62-43a74084ea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:27.360764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f7e7d657-289d-44d3-bd62-43a74084ea61 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:27.365250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f7e7d657-289d-44d3-bd62-43a74084ea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:27.393076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1187/2372] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:27.393683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2698-f46b-402a-bfb8-d8fbedb846c2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:27.406541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c2698-f46b-402a-bfb8-d8fbedb846c2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:27.423731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:27.430375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:27.430855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:27.431344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:27.432231 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:27.432898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:27.444679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:27.496271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1186/2373] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:47:27.499647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7d657-289d-44d3-bd62-43a74084ea61 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:27.512892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e7d657-289d-44d3-bd62-43a74084ea61 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:27.528850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdab5db-facf-4daf-9cc2-2db587afda96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:27.529478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab5db-facf-4daf-9cc2-2db587afda96 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:27.529751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab5db-facf-4daf-9cc2-2db587afda96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:27.530364 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdab5db-facf-4daf-9cc2-2db587afda96 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:27.531464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdab5db-facf-4daf-9cc2-2db587afda96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:27.534058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdab5db-facf-4daf-9cc2-2db587afda96 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:27.636157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1188/2374] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:27 2022] POST /identity/v3/projects => generated 367 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:27.640045 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:27.646491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:27.660813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c5833-b4d9-4003-9cef-d5f77421e0b5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:27.842132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bba648-b37c-4377-8cef-28fc1b351f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:27.842685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bba648-b37c-4377-8cef-28fc1b351f76 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:27.842969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bba648-b37c-4377-8cef-28fc1b351f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:27.843241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bba648-b37c-4377-8cef-28fc1b351f76 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:27.849896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bba648-b37c-4377-8cef-28fc1b351f76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:27.852227 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bba648-b37c-4377-8cef-28fc1b351f76 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:27.924463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1187/2375] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:27 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:27.925670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdab5db-facf-4daf-9cc2-2db587afda96 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:27.936297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:27.949955 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdab5db-facf-4daf-9cc2-2db587afda96 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:27.967321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50509e-a6fd-4455-b02e-aa0fe032b67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:27.968004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50509e-a6fd-4455-b02e-aa0fe032b67e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:27.970558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50509e-a6fd-4455-b02e-aa0fe032b67e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:27.970881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50509e-a6fd-4455-b02e-aa0fe032b67e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:27.973884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50509e-a6fd-4455-b02e-aa0fe032b67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:27.979730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50509e-a6fd-4455-b02e-aa0fe032b67e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:28.017798 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bba648-b37c-4377-8cef-28fc1b351f76 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:28.023873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1189/2376] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:28.033017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bba648-b37c-4377-8cef-28fc1b351f76 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:28.044860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f79084-e8ec-4f22-b9aa-128469898a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:28.045633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79084-e8ec-4f22-b9aa-128469898a08 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:28.046639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79084-e8ec-4f22-b9aa-128469898a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:28.046639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f79084-e8ec-4f22-b9aa-128469898a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:28.047300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f79084-e8ec-4f22-b9aa-128469898a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:28.049127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f79084-e8ec-4f22-b9aa-128469898a08 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:28.080562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1188/2377] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:28.082689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50509e-a6fd-4455-b02e-aa0fe032b67e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:28.101590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50509e-a6fd-4455-b02e-aa0fe032b67e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:28.112838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ced44-7766-4984-ac08-31c05584f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:28.114970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ced44-7766-4984-ac08-31c05584f64d admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:28.115705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ced44-7766-4984-ac08-31c05584f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:28.115705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ced44-7766-4984-ac08-31c05584f64d admin admin] PATH_INFO: `/v3/projects/c2b4c214ea3d47c9b11463c918e2ca55/users/40c4976d1cf042d8aac50a171077d9e2/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:28.170237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ced44-7766-4984-ac08-31c05584f64d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b4c214ea3d47c9b11463c918e2ca55, user_id=40c4976d1cf042d8aac50a171077d9e2, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:28.184063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ced44-7766-4984-ac08-31c05584f64d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:28.232286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1190/2378] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:28 2022] PUT /identity/v3/projects/c2b4c214ea3d47c9b11463c918e2ca55/users/40c4976d1cf042d8aac50a171077d9e2/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:28.238569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0237e-da1b-49ea-b2c4-99234f08c761 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:28.238914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0237e-da1b-49ea-b2c4-99234f08c761 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:28.239164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0237e-da1b-49ea-b2c4-99234f08c761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:28.413407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-42b0237e-da1b-49ea-b2c4-99234f08c761 None None] MFA Rules not processed for user `40c4976d1cf042d8aac50a171077d9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:28.420275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-42b0237e-da1b-49ea-b2c4-99234f08c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:28.569336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1189/2379] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:28.575339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ced44-7766-4984-ac08-31c05584f64d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:28.738395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ced44-7766-4984-ac08-31c05584f64d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:28.749127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e92a272-502c-4045-ac71-8cf469853fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:28.750685 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92a272-502c-4045-ac71-8cf469853fed admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:28.751622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92a272-502c-4045-ac71-8cf469853fed admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:28.752670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e92a272-502c-4045-ac71-8cf469853fed admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:28.753846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92a272-502c-4045-ac71-8cf469853fed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:28.757572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e92a272-502c-4045-ac71-8cf469853fed admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:28.866809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1191/2380] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:28 2022] POST /identity/v3/projects => generated 369 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:28.871835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0237e-da1b-49ea-b2c4-99234f08c761 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:28.918087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0237e-da1b-49ea-b2c4-99234f08c761 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:29.034912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea481f1-7d06-46cd-b069-4c6881e61655 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:29.035337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea481f1-7d06-46cd-b069-4c6881e61655 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:29.040442 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea481f1-7d06-46cd-b069-4c6881e61655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:29.146885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9ea481f1-7d06-46cd-b069-4c6881e61655 None None] MFA Rules not processed for user `17c8209074544082a26183b7d8e122f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:29.157487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9ea481f1-7d06-46cd-b069-4c6881e61655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:29.303733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd728-6f14-4012-8f49-24cae43e6fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:29.309322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd728-6f14-4012-8f49-24cae43e6fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:29.309651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd728-6f14-4012-8f49-24cae43e6fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:29.310003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeffd728-6f14-4012-8f49-24cae43e6fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:29.310596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffd728-6f14-4012-8f49-24cae43e6fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:29.335497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeffd728-6f14-4012-8f49-24cae43e6fc6 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:29.410634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:29.447708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1190/2381] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:28 2022] POST /identity/v3/users => generated 291 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:29.451975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd728-6f14-4012-8f49-24cae43e6fc6 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:29.479001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1192/2382] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:29.498339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea481f1-7d06-46cd-b069-4c6881e61655 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:29.500028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9ea481f1-7d06-46cd-b069-4c6881e61655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:29.527502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeffd728-6f14-4012-8f49-24cae43e6fc6 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:29.573734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e19d2-f9be-45b8-80ca-b878dc56de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:29.576913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e19d2-f9be-45b8-80ca-b878dc56de5b admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:29.577293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e19d2-f9be-45b8-80ca-b878dc56de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:29.577564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e19d2-f9be-45b8-80ca-b878dc56de5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:29.579150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e19d2-f9be-45b8-80ca-b878dc56de5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:29.582820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e19d2-f9be-45b8-80ca-b878dc56de5b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:29.624331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1191/2383] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:29.632504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e19d2-f9be-45b8-80ca-b878dc56de5b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:29.664766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e19d2-f9be-45b8-80ca-b878dc56de5b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:29.676324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ae0a-969e-47cd-b661-df63c2609b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:29.678701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ae0a-969e-47cd-b661-df63c2609b3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:29.679398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ae0a-969e-47cd-b661-df63c2609b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:29.681434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:29.682575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772ae0a-969e-47cd-b661-df63c2609b3d admin admin] PATH_INFO: `/v3/projects/4862110a959746a39a0dfc1c1034fa88/users/16507e9160fb4df9ae477bbdbcd06114/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:29.717503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea481f1-7d06-46cd-b069-4c6881e61655 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:29.732414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9befe2-f81e-41c1-9a0d-0c04b982b0c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:29.733091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9befe2-f81e-41c1-9a0d-0c04b982b0c5 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:29.733938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9befe2-f81e-41c1-9a0d-0c04b982b0c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:29.733938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9befe2-f81e-41c1-9a0d-0c04b982b0c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:29.748081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772ae0a-969e-47cd-b661-df63c2609b3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4862110a959746a39a0dfc1c1034fa88, user_id=16507e9160fb4df9ae477bbdbcd06114, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:29.753359 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772ae0a-969e-47cd-b661-df63c2609b3d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:29.764657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9befe2-f81e-41c1-9a0d-0c04b982b0c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:29.766337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9befe2-f81e-41c1-9a0d-0c04b982b0c5 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:29.789993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1192/2384] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:29 2022] PUT /identity/v3/projects/4862110a959746a39a0dfc1c1034fa88/users/16507e9160fb4df9ae477bbdbcd06114/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:29.793708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ae0a-969e-47cd-b661-df63c2609b3d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:29.809629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1193/2385] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:30.341981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772ae0a-969e-47cd-b661-df63c2609b3d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:30.366480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388710c-f406-4cf3-b5e3-ef1872d5180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:30.367340 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388710c-f406-4cf3-b5e3-ef1872d5180d admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:30.367853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388710c-f406-4cf3-b5e3-ef1872d5180d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:30.368309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388710c-f406-4cf3-b5e3-ef1872d5180d admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:30.369128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388710c-f406-4cf3-b5e3-ef1872d5180d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:30.375031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388710c-f406-4cf3-b5e3-ef1872d5180d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:30.392533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9befe2-f81e-41c1-9a0d-0c04b982b0c5 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:30.405458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1193/2386] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 613 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:30.409048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9befe2-f81e-41c1-9a0d-0c04b982b0c5 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:30.416340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:30.417609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:30.418422 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:30.418889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] PATH_INFO: `/v3/projects/4862110a959746a39a0dfc1c1034fa88/users/16507e9160fb4df9ae477bbdbcd06114/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:30.421538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4862110a959746a39a0dfc1c1034fa88, user_id=16507e9160fb4df9ae477bbdbcd06114, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:30.427214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:30.460611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1194/2387] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:30 2022] PUT /identity/v3/projects/4862110a959746a39a0dfc1c1034fa88/users/16507e9160fb4df9ae477bbdbcd06114/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:30.475804 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3830f1e-dea8-4be0-980c-2b597949ed4f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:30.476671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3830f1e-dea8-4be0-980c-2b597949ed4f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:30.476671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3830f1e-dea8-4be0-980c-2b597949ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:30.629322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a3830f1e-dea8-4be0-980c-2b597949ed4f None None] MFA Rules not processed for user `16507e9160fb4df9ae477bbdbcd06114`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:30.630693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a3830f1e-dea8-4be0-980c-2b597949ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:30.934775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1194/2388] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:30.968062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:30.970088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:31.145235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78eb515-dadd-4aca-afed-8faaa94e29e1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:31.162237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b41be-dfe2-4461-a0d4-af26d6e546fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:31.162870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b41be-dfe2-4461-a0d4-af26d6e546fb service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:31.163329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b41be-dfe2-4461-a0d4-af26d6e546fb service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:31.163758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b41be-dfe2-4461-a0d4-af26d6e546fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:31.203829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b41be-dfe2-4461-a0d4-af26d6e546fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:31.205792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b41be-dfe2-4461-a0d4-af26d6e546fb service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:31.241855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1195/2389] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:31.326748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3830f1e-dea8-4be0-980c-2b597949ed4f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:31.346920 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3830f1e-dea8-4be0-980c-2b597949ed4f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:31.359818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:31.360500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:31.361147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:31.361147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:31.482027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:31.511063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:31.515541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:31.546933 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1195/2390] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:31.811457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99de8-4300-4c50-bf83-3bb7ceb8c8ed None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:31.811927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99de8-4300-4c50-bf83-3bb7ceb8c8ed None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:31.812267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca99de8-4300-4c50-bf83-3bb7ceb8c8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:31.852969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0ca99de8-4300-4c50-bf83-3bb7ceb8c8ed None None] MFA Rules not processed for user `17c8209074544082a26183b7d8e122f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:31.854258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0ca99de8-4300-4c50-bf83-3bb7ceb8c8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:32.000610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1196/2391] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:33.423862 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:33.426515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:33.582782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7ab23-3a8c-4085-a0ad-346921d6e13a service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:33.600725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:33.602364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:33.602739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:33.603269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] PATH_INFO: `/v3/users/f71fafcf36604be9b38da06a7a3bb08e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:33.605832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f71fafcf36604be9b38da06a7a3bb08e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:33.611099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:33.738716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f71fafcf36604be9b38da06a7a3bb08e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:33.740597 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f71fafcf36604be9b38da06a7a3bb08e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:33.766245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f71fafcf36604be9b38da06a7a3bb08e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:33.796675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f71fafcf36604be9b38da06a7a3bb08e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:33.816654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f71fafcf36604be9b38da06a7a3bb08e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:33.836776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1196/2392] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:33 2022] DELETE /identity/v3/users/f71fafcf36604be9b38da06a7a3bb08e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:33.838417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57329f-5551-4de5-89a1-0747a3e7ab5a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:33.839252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57329f-5551-4de5-89a1-0747a3e7ab5a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:33.839678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57329f-5551-4de5-89a1-0747a3e7ab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:33.884023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4f57329f-5551-4de5-89a1-0747a3e7ab5a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:33.885683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4f57329f-5551-4de5-89a1-0747a3e7ab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:34.022051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1197/2393] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:34.034109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:34.036144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:34.236324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9445eaa4-0c8b-4a85-af09-a18b9dc72eb2 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:34.250510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:34.250856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:34.251142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:34.251418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:34.272782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:34.277356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:34.301673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1197/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:35.798682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad3c5-4e5c-4ac7-906d-5a34a75b9749 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:35.799284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad3c5-4e5c-4ac7-906d-5a34a75b9749 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:35.801715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ad3c5-4e5c-4ac7-906d-5a34a75b9749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:35.941765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-145ad3c5-4e5c-4ac7-906d-5a34a75b9749 None None] MFA Rules not processed for user `65fae5d506444eac8336b78d87d6fd51`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:35.949208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-145ad3c5-4e5c-4ac7-906d-5a34a75b9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:35.994578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:36.165506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1198/2395] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:36.180323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:36.185462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:36.211117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:36.211443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ad3c5-4e5c-4ac7-906d-5a34a75b9749 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:36.212897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-145ad3c5-4e5c-4ac7-906d-5a34a75b9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:36.259339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ad3c5-4e5c-4ac7-906d-5a34a75b9749 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:36.268236 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:36.272260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:36.272727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:36.273242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] PATH_INFO: `/v3/projects/5510fa61ffd04de09c194a352245987d` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:36.276403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5510fa61ffd04de09c194a352245987d)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:36.278880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:36.356533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5510fa61ffd04de09c194a352245987d', 'request_id': 'req-765ca47e-2b7b-4cde-8a33-9e486316b977'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:36.415721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5510fa61ffd04de09c194a352245987d', 'request_id': 'req-765ca47e-2b7b-4cde-8a33-9e486316b977'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:36.424098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5510fa61ffd04de09c194a352245987d', 'request_id': 'req-765ca47e-2b7b-4cde-8a33-9e486316b977'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:36.469600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] The token cache is being invalidate because project 5510fa61ffd04de09c194a352245987d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:36.469600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:36.471914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-765ca47e-2b7b-4cde-8a33-9e486316b977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:36.486675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1199/2396] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:36 2022] DELETE /identity/v3/projects/5510fa61ffd04de09c194a352245987d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:36.488951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35630-2db2-4bcd-9fa1-b01e5918f46c service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:36.492307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8daa98-d4ca-40ba-832f-d97f9c6b8e48 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:36.495465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8daa98-d4ca-40ba-832f-d97f9c6b8e48 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:36.495801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8daa98-d4ca-40ba-832f-d97f9c6b8e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:36.554159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6f8daa98-d4ca-40ba-832f-d97f9c6b8e48 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:36.557365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6f8daa98-d4ca-40ba-832f-d97f9c6b8e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:36.656192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdae9a-4057-452f-b18a-dffea2063582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:36.656835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdae9a-4057-452f-b18a-dffea2063582 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:36.657302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdae9a-4057-452f-b18a-dffea2063582 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:36.657587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdae9a-4057-452f-b18a-dffea2063582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:36.659555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-34bdae9a-4057-452f-b18a-dffea2063582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:36.792088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1200/2397] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:36.794315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8daa98-d4ca-40ba-832f-d97f9c6b8e48 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:36.794489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdae9a-4057-452f-b18a-dffea2063582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:36.796735 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdae9a-4057-452f-b18a-dffea2063582 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:36.800506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6f8daa98-d4ca-40ba-832f-d97f9c6b8e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:36.811065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1198/2398] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:36.812740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81728c-cf34-4d06-a88f-9c890d2a3c1c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:36.813101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81728c-cf34-4d06-a88f-9c890d2a3c1c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:36.813374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81728c-cf34-4d06-a88f-9c890d2a3c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:36.830438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8daa98-d4ca-40ba-832f-d97f9c6b8e48 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:36.838795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3d81728c-cf34-4d06-a88f-9c890d2a3c1c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:36.840433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3d81728c-cf34-4d06-a88f-9c890d2a3c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:36.842449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:36.843293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:36.843731 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:36.844596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] PATH_INFO: `/v3/users/40c4976d1cf042d8aac50a171077d9e2` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:36.846763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40c4976d1cf042d8aac50a171077d9e2)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:36.850664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:36.852392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1199/2399] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:36.859030 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81728c-cf34-4d06-a88f-9c890d2a3c1c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:36.874010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81728c-cf34-4d06-a88f-9c890d2a3c1c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:36.880399 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:36.880969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:36.881320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:36.881657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:36.882824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:36.883207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:36.885009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:36.905633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1200/2400] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:36.906657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:36.921104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c84ad9-4192-4b71-b891-c0272636e89c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:36.926966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe8bde-36ce-4d81-a55c-d4242ed4ace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:36.927724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8bde-36ce-4d81-a55c-d4242ed4ace1 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:36.928195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8bde-36ce-4d81-a55c-d4242ed4ace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:36.928601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8bde-36ce-4d81-a55c-d4242ed4ace1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:36.930976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe8bde-36ce-4d81-a55c-d4242ed4ace1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:36.932903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:36.933490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe8bde-36ce-4d81-a55c-d4242ed4ace1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:36.971403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:36.980680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40c4976d1cf042d8aac50a171077d9e2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:36.988678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1201/2401] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:36 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:36.990860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe8bde-36ce-4d81-a55c-d4242ed4ace1 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:37.013599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40c4976d1cf042d8aac50a171077d9e2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:37.016120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40c4976d1cf042d8aac50a171077d9e2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:37.017857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40c4976d1cf042d8aac50a171077d9e2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:37.048393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-198a4b8c-fafd-4c71-b435-4f76e7b1d1a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40c4976d1cf042d8aac50a171077d9e2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:37.097848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1201/2402] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:36 2022] DELETE /identity/v3/users/40c4976d1cf042d8aac50a171077d9e2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:37.102911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2f730-07dc-4234-b2d1-e274bfd6a641 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:37.103199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2f730-07dc-4234-b2d1-e274bfd6a641 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:37.103477 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d2f730-07dc-4234-b2d1-e274bfd6a641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:37.171727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe8bde-36ce-4d81-a55c-d4242ed4ace1 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:37.187044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d4d2f730-07dc-4234-b2d1-e274bfd6a641 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:37.190494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d4d2f730-07dc-4234-b2d1-e274bfd6a641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:37.359885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1202/2403] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:37.397756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:37.399876 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:37.403841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2f730-07dc-4234-b2d1-e274bfd6a641 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:37.405541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d4d2f730-07dc-4234-b2d1-e274bfd6a641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:37.407491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:37.408185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:37.409421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:37.412694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:37.470068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1202/2404] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:36 2022] POST /identity/v3/users => generated 286 bytes in 481 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:37.474475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:37.489127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:37.514515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09458d-146d-4ba4-a18d-92d6655b96e3 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:37.536990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b317bd-779f-4965-83d2-301f2f550c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:37.541771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b317bd-779f-4965-83d2-301f2f550c6f admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:37.542127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b317bd-779f-4965-83d2-301f2f550c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:37.542441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b317bd-779f-4965-83d2-301f2f550c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:37.555578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d2f730-07dc-4234-b2d1-e274bfd6a641 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:37.561288 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b317bd-779f-4965-83d2-301f2f550c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:37.567759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b317bd-779f-4965-83d2-301f2f550c6f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:37.575275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b364c-98c2-4f38-b4b7-429ffe242516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:37.582164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b364c-98c2-4f38-b4b7-429ffe242516 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:37.582478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b364c-98c2-4f38-b4b7-429ffe242516 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:37.582756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b364c-98c2-4f38-b4b7-429ffe242516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:37.611189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b364c-98c2-4f38-b4b7-429ffe242516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:37.612703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b364c-98c2-4f38-b4b7-429ffe242516 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:37.617188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1203/2405] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:37.618418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b317bd-779f-4965-83d2-301f2f550c6f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:37.641954 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1203/2406] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:37.666850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b317bd-779f-4965-83d2-301f2f550c6f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:37.686439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24727048-3ab1-4f02-a116-d8e9fb6b4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:37.690473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24727048-3ab1-4f02-a116-d8e9fb6b4c4e admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:37.690769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24727048-3ab1-4f02-a116-d8e9fb6b4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:37.691112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24727048-3ab1-4f02-a116-d8e9fb6b4c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:37.691741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24727048-3ab1-4f02-a116-d8e9fb6b4c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:37.701041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24727048-3ab1-4f02-a116-d8e9fb6b4c4e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:37.735919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1204/2407] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:37.740449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b364c-98c2-4f38-b4b7-429ffe242516 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:37.755861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b364c-98c2-4f38-b4b7-429ffe242516 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:37.779508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:37.780219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:37.780690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:37.780978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] PATH_INFO: `/v3/projects/2c305b0064b048dd9ec6d3e8b6fd5da1/users/dd22110f6b0f48a7af4c4645ae9c7e2a/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:37.856730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c305b0064b048dd9ec6d3e8b6fd5da1, user_id=dd22110f6b0f48a7af4c4645ae9c7e2a, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:37.862427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:37.908838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8816-1918-4275-9ba0-37bc08fe226f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:37.909259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8816-1918-4275-9ba0-37bc08fe226f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:37.909633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e8816-1918-4275-9ba0-37bc08fe226f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:37.917245 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1204/2408] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:37 2022] PUT /identity/v3/projects/2c305b0064b048dd9ec6d3e8b6fd5da1/users/dd22110f6b0f48a7af4c4645ae9c7e2a/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:38.001696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bd5e8816-1918-4275-9ba0-37bc08fe226f None None] MFA Rules not processed for user `dd22110f6b0f48a7af4c4645ae9c7e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:38.002989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bd5e8816-1918-4275-9ba0-37bc08fe226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:38.267816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:38.270188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1205/2409] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:38.271125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:38.356675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:38.437965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb95ce-0e8b-48a2-a8ed-1d1d6d4cc2ab admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:38.450885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:38.451620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:38.452089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:38.452438 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:38.471004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:38.473366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:38.491304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1205/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:47:39.065127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8816-1918-4275-9ba0-37bc08fe226f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:39.069456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bd5e8816-1918-4275-9ba0-37bc08fe226f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:39.093482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:39.187071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5e8816-1918-4275-9ba0-37bc08fe226f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:39.198079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:39.198834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:39.199214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:39.199598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] PATH_INFO: `/v3/projects/c2b4c214ea3d47c9b11463c918e2ca55` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:39.201393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:39.203852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:39.207840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b4c214ea3d47c9b11463c918e2ca55)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:39.209902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:39.232296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225844-dbeb-4ca9-aabb-56421dc7bc51 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:39.244550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:39.245700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:39.246196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:39.246689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] PATH_INFO: `/v3/users/8e0dd9b1866a4c9391f2ce8d45bb76ef` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:39.258766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e0dd9b1866a4c9391f2ce8d45bb76ef)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:39.262817 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:39.281215 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b4c214ea3d47c9b11463c918e2ca55', 'request_id': 'req-1b86cccc-5128-4784-b60d-1d2f06998b60'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.293112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b4c214ea3d47c9b11463c918e2ca55', 'request_id': 'req-1b86cccc-5128-4784-b60d-1d2f06998b60'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.306053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b4c214ea3d47c9b11463c918e2ca55', 'request_id': 'req-1b86cccc-5128-4784-b60d-1d2f06998b60'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.322026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] The token cache is being invalidate because project c2b4c214ea3d47c9b11463c918e2ca55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:39.322388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.323637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.329488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1206/2411] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:39 2022] DELETE /identity/v3/projects/c2b4c214ea3d47c9b11463c918e2ca55 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:39.330771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:39.334921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:39.354112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e0dd9b1866a4c9391f2ce8d45bb76ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.383260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e0dd9b1866a4c9391f2ce8d45bb76ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.384940 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e0dd9b1866a4c9391f2ce8d45bb76ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.385788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e0dd9b1866a4c9391f2ce8d45bb76ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.406911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-01cc0cce-f3be-49ba-af70-1fe875e969fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e0dd9b1866a4c9391f2ce8d45bb76ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.427177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86cccc-5128-4784-b60d-1d2f06998b60 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:39.432679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:39.433411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:39.433695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:39.433980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] PATH_INFO: `/v3/users/16507e9160fb4df9ae477bbdbcd06114` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:39.435675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] RBAC: Authorizing `identity:delete_user(user_id=16507e9160fb4df9ae477bbdbcd06114)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:39.437671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:39.451465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1206/2412] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:39 2022] DELETE /identity/v3/users/8e0dd9b1866a4c9391f2ce8d45bb76ef => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:39.520706 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:39.553420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16507e9160fb4df9ae477bbdbcd06114'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.554714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16507e9160fb4df9ae477bbdbcd06114'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.572156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16507e9160fb4df9ae477bbdbcd06114'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.595260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16507e9160fb4df9ae477bbdbcd06114'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.607236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16507e9160fb4df9ae477bbdbcd06114'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:39.633824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1207/2413] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:39 2022] DELETE /identity/v3/users/16507e9160fb4df9ae477bbdbcd06114 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:40.217510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50fe9e-272c-4fa4-84d5-64026982920d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:40.218507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50fe9e-272c-4fa4-84d5-64026982920d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:40.219842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50fe9e-272c-4fa4-84d5-64026982920d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:40.273996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3e50fe9e-272c-4fa4-84d5-64026982920d None None] MFA Rules not processed for user `dd22110f6b0f48a7af4c4645ae9c7e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:40.277575 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3e50fe9e-272c-4fa4-84d5-64026982920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:40.379057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:40.380615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:40.395957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1207/2414] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:40.533321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6dc9d-4546-4a0f-af17-c3314722e59c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:40.543474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:40.544228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:40.544526 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:40.545318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] PATH_INFO: `/v3/projects/2879b73c32f14cf1a5a4e609dfd323a9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:40.546941 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2879b73c32f14cf1a5a4e609dfd323a9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:40.550758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:40.631450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2879b73c32f14cf1a5a4e609dfd323a9', 'request_id': 'req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:40.646157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2879b73c32f14cf1a5a4e609dfd323a9', 'request_id': 'req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:40.658094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2879b73c32f14cf1a5a4e609dfd323a9', 'request_id': 'req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:40.674218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] The token cache is being invalidate because project 2879b73c32f14cf1a5a4e609dfd323a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:40.674638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:40.685461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:40.689536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1208/2415] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:40 2022] DELETE /identity/v3/projects/2879b73c32f14cf1a5a4e609dfd323a9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:40.697316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50fe9e-272c-4fa4-84d5-64026982920d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:40.717857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50fe9e-272c-4fa4-84d5-64026982920d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:40.817231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:40.870628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:40.871585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:40.872040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:40.872563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] PATH_INFO: `/v3/users/90fdca4d71664454940981943540c52b` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:40.875934 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90fdca4d71664454940981943540c52b)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:40.878107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:40.981292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:40.983168 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:41.005727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a4783b-4b8d-42aa-a6f1-ac1150674e99 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:41.006804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90fdca4d71664454940981943540c52b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.022013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:41.024201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:41.024563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:41.025140 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] PATH_INFO: `/v3/projects/4862110a959746a39a0dfc1c1034fa88` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:41.027672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4862110a959746a39a0dfc1c1034fa88)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:41.030275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:41.034649 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90fdca4d71664454940981943540c52b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.036638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90fdca4d71664454940981943540c52b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.040724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90fdca4d71664454940981943540c52b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.062067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab2f5ac8-f47f-4608-9a09-774aa25e2a31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90fdca4d71664454940981943540c52b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.092665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1208/2416] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:40 2022] DELETE /identity/v3/users/90fdca4d71664454940981943540c52b => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:41.126953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:41.143569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4862110a959746a39a0dfc1c1034fa88', 'request_id': 'req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.164260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4862110a959746a39a0dfc1c1034fa88', 'request_id': 'req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.172855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4862110a959746a39a0dfc1c1034fa88', 'request_id': 'req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.197561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] The token cache is being invalidate because project 4862110a959746a39a0dfc1c1034fa88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:41.197858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.208529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-45a8c0fd-2e8a-4aab-aeb9-bdcdcc79e581 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:41.210447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1209/2417] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:40 2022] DELETE /identity/v3/projects/4862110a959746a39a0dfc1c1034fa88 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:41.215133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbca50-dde5-4339-9030-5e92c115109f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:41.215552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbca50-dde5-4339-9030-5e92c115109f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:41.215925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbca50-dde5-4339-9030-5e92c115109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:41.260619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c3bbca50-dde5-4339-9030-5e92c115109f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:41.271826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c3bbca50-dde5-4339-9030-5e92c115109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:41.592156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1209/2418] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:41.602044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44f9d-962e-4ae1-9527-12b9beccfe87 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:41.603053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44f9d-962e-4ae1-9527-12b9beccfe87 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:41.603539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44f9d-962e-4ae1-9527-12b9beccfe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:41.673901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e2f44f9d-962e-4ae1-9527-12b9beccfe87 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:41.676410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e2f44f9d-962e-4ae1-9527-12b9beccfe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:41.715080 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1210/2419] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:41.715688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbca50-dde5-4339-9030-5e92c115109f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:41.751552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbca50-dde5-4339-9030-5e92c115109f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:41.752104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44f9d-962e-4ae1-9527-12b9beccfe87 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:41.753638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e2f44f9d-962e-4ae1-9527-12b9beccfe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:41.762617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:41.764827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:41.765336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:41.765818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:41.767825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:41.768504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:41.772680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:41.784092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44f9d-962e-4ae1-9527-12b9beccfe87 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:41.797306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:41.798818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:41.798937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:41.799201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] PATH_INFO: `/v3/projects/9fdd48837f544ad3b22686fb40e4327e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:41.800964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fdd48837f544ad3b22686fb40e4327e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:41.803853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:41.804406 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1210/2420] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:41.807427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:41.855511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37047636-937e-4dd2-9723-51ea4155da9c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:41.895387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0a826-e813-4994-bb58-2bf80bf721d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:41.895762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0a826-e813-4994-bb58-2bf80bf721d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:41.895930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0a826-e813-4994-bb58-2bf80bf721d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:41.896116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0a826-e813-4994-bb58-2bf80bf721d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:41.896763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0a826-e813-4994-bb58-2bf80bf721d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:41.899590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0a826-e813-4994-bb58-2bf80bf721d2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:41.991422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fdd48837f544ad3b22686fb40e4327e', 'request_id': 'req-71994b64-ab98-4f71-bd07-62a32ff64840'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:42.013178 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fdd48837f544ad3b22686fb40e4327e', 'request_id': 'req-71994b64-ab98-4f71-bd07-62a32ff64840'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:42.028942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fdd48837f544ad3b22686fb40e4327e', 'request_id': 'req-71994b64-ab98-4f71-bd07-62a32ff64840'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:42.050114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1211/2421] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:41 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:42.055607 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba832-8fe5-40c2-afbd-65d425818fc4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.056536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba832-8fe5-40c2-afbd-65d425818fc4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.057178 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ba832-8fe5-40c2-afbd-65d425818fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.059234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] The token cache is being invalidate because project 9fdd48837f544ad3b22686fb40e4327e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:42.059558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:42.062556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:42.066134 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1211/2422] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:41 2022] DELETE /identity/v3/projects/9fdd48837f544ad3b22686fb40e4327e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:42.067954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:42.073237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:42.109218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f65ba832-8fe5-40c2-afbd-65d425818fc4 None None] MFA Rules not processed for user `63e782a27e764b1ca9302094f788815f`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:42.110473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f65ba832-8fe5-40c2-afbd-65d425818fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:42.169701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:42.228122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1212/2423] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:42.229830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a1f15-63f4-4e13-bfb0-26da0f8b5da0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.230260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a1f15-63f4-4e13-bfb0-26da0f8b5da0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.230700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a1f15-63f4-4e13-bfb0-26da0f8b5da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.247760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71994b64-ab98-4f71-bd07-62a32ff64840 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:42.304116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f85a1f15-63f4-4e13-bfb0-26da0f8b5da0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:42.311829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f85a1f15-63f4-4e13-bfb0-26da0f8b5da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:42.429815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:42.468750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451a80-c8ed-41f6-a2bf-ef449d2619ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:42.470717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451a80-c8ed-41f6-a2bf-ef449d2619ef admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.472145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451a80-c8ed-41f6-a2bf-ef449d2619ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.472580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3451a80-c8ed-41f6-a2bf-ef449d2619ef admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.474446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3451a80-c8ed-41f6-a2bf-ef449d2619ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:42.479580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3451a80-c8ed-41f6-a2bf-ef449d2619ef admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:42.536790 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1212/2424] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:42 2022] POST /identity/v3/users => generated 288 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:42.537977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451a80-c8ed-41f6-a2bf-ef449d2619ef admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:42.558267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1213/2425] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:42.559754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7554-19fa-43ec-aba4-179b153d7ea4 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.560033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7554-19fa-43ec-aba4-179b153d7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.563431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae7554-19fa-43ec-aba4-179b153d7ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.568141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3451a80-c8ed-41f6-a2bf-ef449d2619ef admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:42.579957 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd73aad-e1aa-407a-9e24-e9b2e1bb1bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:42.581860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73aad-e1aa-407a-9e24-e9b2e1bb1bee admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.582839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73aad-e1aa-407a-9e24-e9b2e1bb1bee admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.583128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73aad-e1aa-407a-9e24-e9b2e1bb1bee admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.587133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd73aad-e1aa-407a-9e24-e9b2e1bb1bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:42.590789 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd73aad-e1aa-407a-9e24-e9b2e1bb1bee admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:42.617721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1213/2426] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:42.623015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd73aad-e1aa-407a-9e24-e9b2e1bb1bee admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:42.652533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd73aad-e1aa-407a-9e24-e9b2e1bb1bee admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:42.664378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd7507-0869-4f12-ba63-765003bd27e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:42.664378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7507-0869-4f12-ba63-765003bd27e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.664378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7507-0869-4f12-ba63-765003bd27e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.664743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd7507-0869-4f12-ba63-765003bd27e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.669760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd7507-0869-4f12-ba63-765003bd27e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:42.669760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd7507-0869-4f12-ba63-765003bd27e0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:42.686606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-daae7554-19fa-43ec-aba4-179b153d7ea4 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:42.687886 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-daae7554-19fa-43ec-aba4-179b153d7ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:42.706956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1214/2427] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:42.708291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd7507-0869-4f12-ba63-765003bd27e0 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:42.723025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd7507-0869-4f12-ba63-765003bd27e0 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:42.736481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393865bb-3004-4159-8455-65f370741909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:42.736703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1214/2428] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:42.737263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393865bb-3004-4159-8455-65f370741909 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.737547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393865bb-3004-4159-8455-65f370741909 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.738093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393865bb-3004-4159-8455-65f370741909 admin admin] PATH_INFO: `/v3/projects/33bedce3bf8d49aa8bfedeefb883059a/users/d507b12acddb4cc4ba2d95f58fa58ff8/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.744105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7554-19fa-43ec-aba4-179b153d7ea4 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:42.782429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393865bb-3004-4159-8455-65f370741909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bedce3bf8d49aa8bfedeefb883059a, user_id=d507b12acddb4cc4ba2d95f58fa58ff8, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:42.785556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393865bb-3004-4159-8455-65f370741909 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:42.804072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae7554-19fa-43ec-aba4-179b153d7ea4 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:42.839760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1215/2429] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:42 2022] PUT /identity/v3/projects/33bedce3bf8d49aa8bfedeefb883059a/users/d507b12acddb4cc4ba2d95f58fa58ff8/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:42.843739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70ab9-4e67-4c98-ac15-f53554cca37f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.844044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70ab9-4e67-4c98-ac15-f53554cca37f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.844922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a70ab9-4e67-4c98-ac15-f53554cca37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.864032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:42.864697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:42.864981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:42.865254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:42.865914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:42.866231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:42.867923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:42.915592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-71a70ab9-4e67-4c98-ac15-f53554cca37f None None] MFA Rules not processed for user `d507b12acddb4cc4ba2d95f58fa58ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:42.917564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-71a70ab9-4e67-4c98-ac15-f53554cca37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:42.919106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1215/2430] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:42.923909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:42.947730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f517b9-0df3-4fd3-810e-59be6cfbaae7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:43.251886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1216/2431] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:47:43.264966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba510e6a-f18f-4a4d-a38d-925eaf924e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:43.265187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a70ab9-4e67-4c98-ac15-f53554cca37f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:43.265597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba510e6a-f18f-4a4d-a38d-925eaf924e87 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:43.265880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba510e6a-f18f-4a4d-a38d-925eaf924e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:43.266151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba510e6a-f18f-4a4d-a38d-925eaf924e87 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:43.266504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-71a70ab9-4e67-4c98-ac15-f53554cca37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:43.266789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba510e6a-f18f-4a4d-a38d-925eaf924e87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:43.272283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba510e6a-f18f-4a4d-a38d-925eaf924e87 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:43.380893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1216/2432] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:42 2022] POST /identity/v3/projects => generated 385 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:43.387942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba510e6a-f18f-4a4d-a38d-925eaf924e87 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:43.528107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a70ab9-4e67-4c98-ac15-f53554cca37f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:43.539005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:43.594411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba510e6a-f18f-4a4d-a38d-925eaf924e87 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:43.615928 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71df5b-a47d-4624-9a06-31e12bf4437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:43.618360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71df5b-a47d-4624-9a06-31e12bf4437d admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:43.619202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71df5b-a47d-4624-9a06-31e12bf4437d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:43.619202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71df5b-a47d-4624-9a06-31e12bf4437d admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:43.620494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71df5b-a47d-4624-9a06-31e12bf4437d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:43.627970 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:43.629064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71df5b-a47d-4624-9a06-31e12bf4437d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:43.661861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7810b-d3f8-4802-bf9b-a51304a0b8d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c0bf4de3a1442c8b856efbfac436fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:43.670732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7810b-d3f8-4802-bf9b-a51304a0b8d4 service glance] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:43.670732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7810b-d3f8-4802-bf9b-a51304a0b8d4 service glance] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:43.670732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7810b-d3f8-4802-bf9b-a51304a0b8d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:43.734037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1217/2433] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:43 2022] POST /identity/v3/users => generated 293 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:43.739954 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71df5b-a47d-4624-9a06-31e12bf4437d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:43.796799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71df5b-a47d-4624-9a06-31e12bf4437d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:43.850215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f2542-9513-4b70-b3f0-cc8d9896253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:43.851112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f2542-9513-4b70-b3f0-cc8d9896253b admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:43.851541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f2542-9513-4b70-b3f0-cc8d9896253b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:43.851832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f2542-9513-4b70-b3f0-cc8d9896253b admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:43.852530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f2542-9513-4b70-b3f0-cc8d9896253b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:43.865294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744f2542-9513-4b70-b3f0-cc8d9896253b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:43.907054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1218/2434] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:43.907597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f2542-9513-4b70-b3f0-cc8d9896253b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:43.913001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7810b-d3f8-4802-bf9b-a51304a0b8d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:43.916195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7810b-d3f8-4802-bf9b-a51304a0b8d4 service glance] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:43.928017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f2542-9513-4b70-b3f0-cc8d9896253b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:43.942998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1217/2435] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:47:43.958647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf68ebf-2ae5-44a8-98b9-ce2c6b56a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:43.958647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf68ebf-2ae5-44a8-98b9-ce2c6b56a07c admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:43.958647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf68ebf-2ae5-44a8-98b9-ce2c6b56a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:43.959094 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf68ebf-2ae5-44a8-98b9-ce2c6b56a07c admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:43.962370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf68ebf-2ae5-44a8-98b9-ce2c6b56a07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:43.967680 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf68ebf-2ae5-44a8-98b9-ce2c6b56a07c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:44.011133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7810b-d3f8-4802-bf9b-a51304a0b8d4 service glance] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:44.025669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1219/2436] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:44.041260 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7810b-d3f8-4802-bf9b-a51304a0b8d4 service glance] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:44.080528 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:44.082667 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:44.082968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:44.083298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] PATH_INFO: `/v3/projects/397429bf95ae4a98a1c5b1161bf28d2e/users/80c972bb47974991a76937d302557eb1/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:44.139042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397429bf95ae4a98a1c5b1161bf28d2e, user_id=80c972bb47974991a76937d302557eb1, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:44.142849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:44.197386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15cde0-c126-47c1-83db-2c57489a9a5e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:44.197700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15cde0-c126-47c1-83db-2c57489a9a5e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:44.198047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15cde0-c126-47c1-83db-2c57489a9a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:44.200897 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1218/2437] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:44 2022] PUT /identity/v3/projects/397429bf95ae4a98a1c5b1161bf28d2e/users/80c972bb47974991a76937d302557eb1/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:44.266833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-da15cde0-c126-47c1-83db-2c57489a9a5e None None] MFA Rules not processed for user `80c972bb47974991a76937d302557eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:44.269197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-da15cde0-c126-47c1-83db-2c57489a9a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:44.439790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1220/2438] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:44.453047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:44.454884 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:44.601243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cbb8e7-a2f5-4ce3-bbaf-cbbe39af2227 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:44.609470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f78615-aa68-46cb-8597-63c233990ed1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:44.610360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78615-aa68-46cb-8597-63c233990ed1 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:44.610771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78615-aa68-46cb-8597-63c233990ed1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:44.612189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78615-aa68-46cb-8597-63c233990ed1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:44.632956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f78615-aa68-46cb-8597-63c233990ed1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:44.640444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f78615-aa68-46cb-8597-63c233990ed1 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:44.661483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1219/2439] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:44.709209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15cde0-c126-47c1-83db-2c57489a9a5e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:44.921744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15cde0-c126-47c1-83db-2c57489a9a5e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:44.930100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:44.931156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:44.931621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:44.932058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] PATH_INFO: `/v3/users/80c972bb47974991a76937d302557eb1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:44.934162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c972bb47974991a76937d302557eb1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:44.936859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:45.071253 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:45.100449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c972bb47974991a76937d302557eb1'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.115091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c972bb47974991a76937d302557eb1'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.116648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c972bb47974991a76937d302557eb1'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.117417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c972bb47974991a76937d302557eb1'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.133689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c972bb47974991a76937d302557eb1'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.151196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1221/2440] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:44 2022] DELETE /identity/v3/users/80c972bb47974991a76937d302557eb1 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:45.156193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615618-d223-4487-aef6-b0bdf8fdaf36 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:45.156471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615618-d223-4487-aef6-b0bdf8fdaf36 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:45.156745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b615618-d223-4487-aef6-b0bdf8fdaf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:45.184430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8b615618-d223-4487-aef6-b0bdf8fdaf36 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:45.186581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8b615618-d223-4487-aef6-b0bdf8fdaf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:45.276217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1220/2441] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:45.287643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:45.291548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:45.367008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258346ab-7bda-40d7-bf9b-c46b40c2a228 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:45.373764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b495bcb-2c7a-416d-a67a-c52a6cb3e128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:45.374514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b495bcb-2c7a-416d-a67a-c52a6cb3e128 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:45.374796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b495bcb-2c7a-416d-a67a-c52a6cb3e128 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:45.375199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b495bcb-2c7a-416d-a67a-c52a6cb3e128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:45.392699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b495bcb-2c7a-416d-a67a-c52a6cb3e128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:45.394217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b495bcb-2c7a-416d-a67a-c52a6cb3e128 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:45.407921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1222/2442] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:45.779726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b615618-d223-4487-aef6-b0bdf8fdaf36 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:45.781939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8b615618-d223-4487-aef6-b0bdf8fdaf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:45.811172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b615618-d223-4487-aef6-b0bdf8fdaf36 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:45.829113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:45.829887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:45.830173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:45.830451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] PATH_INFO: `/v3/projects/397429bf95ae4a98a1c5b1161bf28d2e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:45.840556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397429bf95ae4a98a1c5b1161bf28d2e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:45.844501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:45.855459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:45.951522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397429bf95ae4a98a1c5b1161bf28d2e', 'request_id': 'req-49f68992-6c63-44c1-8982-0a0abfe55745'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.966853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397429bf95ae4a98a1c5b1161bf28d2e', 'request_id': 'req-49f68992-6c63-44c1-8982-0a0abfe55745'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.977374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397429bf95ae4a98a1c5b1161bf28d2e', 'request_id': 'req-49f68992-6c63-44c1-8982-0a0abfe55745'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.996616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] The token cache is being invalidate because project 397429bf95ae4a98a1c5b1161bf28d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:45.997268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:45.998224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-49f68992-6c63-44c1-8982-0a0abfe55745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:46.000425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1221/2443] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:45 2022] DELETE /identity/v3/projects/397429bf95ae4a98a1c5b1161bf28d2e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:46.022808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254fd9c-c719-4643-af53-81cf66937c09 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.023405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254fd9c-c719-4643-af53-81cf66937c09 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.023828 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254fd9c-c719-4643-af53-81cf66937c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.054844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2254fd9c-c719-4643-af53-81cf66937c09 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:46.056275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2254fd9c-c719-4643-af53-81cf66937c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:46.205155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1223/2444] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:46.218594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b7571-8790-47d7-800b-345dd5be7763 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.218926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b7571-8790-47d7-800b-345dd5be7763 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.219300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8b7571-8790-47d7-800b-345dd5be7763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.252896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4c8b7571-8790-47d7-800b-345dd5be7763 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:46.260113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4c8b7571-8790-47d7-800b-345dd5be7763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:46.271220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1222/2445] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:46.275706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254fd9c-c719-4643-af53-81cf66937c09 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:46.292522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254fd9c-c719-4643-af53-81cf66937c09 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:46.297610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:46.298276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.298705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.299046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.299780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:46.300144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:46.301854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:46.320768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1224/2446] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:46.321872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b7571-8790-47d7-800b-345dd5be7763 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:46.332765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8b7571-8790-47d7-800b-345dd5be7763 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:46.337630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863bf94-33b1-44f3-81be-2d6fc411de0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:46.338235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863bf94-33b1-44f3-81be-2d6fc411de0d admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.338523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863bf94-33b1-44f3-81be-2d6fc411de0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.338785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863bf94-33b1-44f3-81be-2d6fc411de0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.339623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863bf94-33b1-44f3-81be-2d6fc411de0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:46.345072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863bf94-33b1-44f3-81be-2d6fc411de0d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:46.378865 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1223/2447] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:46 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:47:46.383441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:46.398029 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa3570-44f2-47b0-bc27-4dda1dafa5a4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:46.458975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:46.491358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dbdf0-f80c-4ce5-bfb1-62a8aa3b94f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:46.493159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbdf0-f80c-4ce5-bfb1-62a8aa3b94f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.493514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbdf0-f80c-4ce5-bfb1-62a8aa3b94f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.493860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10dbdf0-f80c-4ce5-bfb1-62a8aa3b94f1 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.494587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dbdf0-f80c-4ce5-bfb1-62a8aa3b94f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:46.496634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10dbdf0-f80c-4ce5-bfb1-62a8aa3b94f1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:46.536299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863bf94-33b1-44f3-81be-2d6fc411de0d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:46.537986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1225/2448] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:46 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:46.560037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863bf94-33b1-44f3-81be-2d6fc411de0d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:46.571162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45ff02-dba9-4dd9-a3af-189a88fbe788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:46.571944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ff02-dba9-4dd9-a3af-189a88fbe788 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.572455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ff02-dba9-4dd9-a3af-189a88fbe788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.572963 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45ff02-dba9-4dd9-a3af-189a88fbe788 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.574230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45ff02-dba9-4dd9-a3af-189a88fbe788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:46.577214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf45ff02-dba9-4dd9-a3af-189a88fbe788 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:46.599092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1224/2449] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:46.600633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dbdf0-f80c-4ce5-bfb1-62a8aa3b94f1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:46.612321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10dbdf0-f80c-4ce5-bfb1-62a8aa3b94f1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:46.618966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca244c1-c0ca-4baf-9ca1-ca8a6f771e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:46.619645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca244c1-c0ca-4baf-9ca1-ca8a6f771e04 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.619929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca244c1-c0ca-4baf-9ca1-ca8a6f771e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.620230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca244c1-c0ca-4baf-9ca1-ca8a6f771e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.620885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca244c1-c0ca-4baf-9ca1-ca8a6f771e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:46.622490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca244c1-c0ca-4baf-9ca1-ca8a6f771e04 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:46.641138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1226/2450] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:46.644985 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45ff02-dba9-4dd9-a3af-189a88fbe788 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:46.658211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45ff02-dba9-4dd9-a3af-189a88fbe788 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:46.672949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9ef7-ec50-4da5-a146-f5e669a714d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:46.673633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9ef7-ec50-4da5-a146-f5e669a714d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.673931 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9ef7-ec50-4da5-a146-f5e669a714d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.674205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b9ef7-ec50-4da5-a146-f5e669a714d9 admin admin] PATH_INFO: `/v3/projects/969fcca38b64414abbe6ae0a70fee86a/users/4187bab415d844728e58ab7a64b4d63a/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.736612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b9ef7-ec50-4da5-a146-f5e669a714d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=969fcca38b64414abbe6ae0a70fee86a, user_id=4187bab415d844728e58ab7a64b4d63a, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:46.740668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b9ef7-ec50-4da5-a146-f5e669a714d9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:46.791498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb956-3ccd-4992-90cd-35471794ecbb None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:46.792985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb956-3ccd-4992-90cd-35471794ecbb None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:46.793496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07cb956-3ccd-4992-90cd-35471794ecbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:46.799295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1225/2451] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:46 2022] PUT /identity/v3/projects/969fcca38b64414abbe6ae0a70fee86a/users/4187bab415d844728e58ab7a64b4d63a/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:46.849998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b07cb956-3ccd-4992-90cd-35471794ecbb None None] MFA Rules not processed for user `4187bab415d844728e58ab7a64b4d63a`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:46.851675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b07cb956-3ccd-4992-90cd-35471794ecbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:46.948772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1227/2452] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:46.953482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9ef7-ec50-4da5-a146-f5e669a714d9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:47.051857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b9ef7-ec50-4da5-a146-f5e669a714d9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:47.058497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeab827-6a61-462a-9e35-ff81556399c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:47.059190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeab827-6a61-462a-9e35-ff81556399c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:47.059533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeab827-6a61-462a-9e35-ff81556399c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:47.059836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeab827-6a61-462a-9e35-ff81556399c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:47.060554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeab827-6a61-462a-9e35-ff81556399c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:47.062751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeab827-6a61-462a-9e35-ff81556399c5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:47.108375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1226/2453] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:46 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:47.109959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb956-3ccd-4992-90cd-35471794ecbb None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:47.150751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07cb956-3ccd-4992-90cd-35471794ecbb None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:47.253610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd4c65-99e8-48b8-8d49-9d82e29c317f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:47.254696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd4c65-99e8-48b8-8d49-9d82e29c317f admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:47.254996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd4c65-99e8-48b8-8d49-9d82e29c317f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:47.255274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd4c65-99e8-48b8-8d49-9d82e29c317f admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:47.256416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd4c65-99e8-48b8-8d49-9d82e29c317f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:47.260370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd4c65-99e8-48b8-8d49-9d82e29c317f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:47.338982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1228/2454] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:47 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:47.343095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeab827-6a61-462a-9e35-ff81556399c5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:47.366882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeab827-6a61-462a-9e35-ff81556399c5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:47.381171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1be1d-b604-47a3-9e34-139f1ea816af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:47.381171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1be1d-b604-47a3-9e34-139f1ea816af admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:47.381510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1be1d-b604-47a3-9e34-139f1ea816af admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:47.381591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1be1d-b604-47a3-9e34-139f1ea816af admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:47.382766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1be1d-b604-47a3-9e34-139f1ea816af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:47.384438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1be1d-b604-47a3-9e34-139f1ea816af admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:47.405961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1227/2455] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:47.409777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd4c65-99e8-48b8-8d49-9d82e29c317f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:47.423725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd4c65-99e8-48b8-8d49-9d82e29c317f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:47.432263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626bfd6-4bec-4ad6-a914-dbc7552b4cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:47.432263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626bfd6-4bec-4ad6-a914-dbc7552b4cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:47.432263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626bfd6-4bec-4ad6-a914-dbc7552b4cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:47.432263 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626bfd6-4bec-4ad6-a914-dbc7552b4cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:47.434678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626bfd6-4bec-4ad6-a914-dbc7552b4cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:47.434678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9626bfd6-4bec-4ad6-a914-dbc7552b4cc0 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:47.450241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1229/2456] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:47.451477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1be1d-b604-47a3-9e34-139f1ea816af admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:47.483137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1be1d-b604-47a3-9e34-139f1ea816af admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:47.499596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91448c7-936f-44c7-bd3e-836306dca728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:47.500750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91448c7-936f-44c7-bd3e-836306dca728 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:47.501261 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91448c7-936f-44c7-bd3e-836306dca728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:47.501774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91448c7-936f-44c7-bd3e-836306dca728 admin admin] PATH_INFO: `/v3/projects/c93dfe498d99463893bae5726ff011d0/users/4960649b744e4012b0fc365be3445396/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:47.508567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:47.541491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91448c7-936f-44c7-bd3e-836306dca728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93dfe498d99463893bae5726ff011d0, user_id=4960649b744e4012b0fc365be3445396, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:47.545009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91448c7-936f-44c7-bd3e-836306dca728 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:47.588885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1228/2457] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:47 2022] PUT /identity/v3/projects/c93dfe498d99463893bae5726ff011d0/users/4960649b744e4012b0fc365be3445396/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:47.591539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e59bc-29e1-4e61-9fd2-a879df086f35 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:47.592333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e59bc-29e1-4e61-9fd2-a879df086f35 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:47.592823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e59bc-29e1-4e61-9fd2-a879df086f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:47.651334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-d27e59bc-29e1-4e61-9fd2-a879df086f35 None None] MFA Rules not processed for user `4960649b744e4012b0fc365be3445396`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:47.652707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d27e59bc-29e1-4e61-9fd2-a879df086f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:47.697519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:47.802198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1230/2458] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:47.806990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91448c7-936f-44c7-bd3e-836306dca728 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:47.918358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91448c7-936f-44c7-bd3e-836306dca728 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:47.928012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0189ff-d508-43d5-ace6-1c3efa31cf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:47.928676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0189ff-d508-43d5-ace6-1c3efa31cf1e admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:47.929083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0189ff-d508-43d5-ace6-1c3efa31cf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:47.929489 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0189ff-d508-43d5-ace6-1c3efa31cf1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:47.930284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0189ff-d508-43d5-ace6-1c3efa31cf1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:47.932259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0189ff-d508-43d5-ace6-1c3efa31cf1e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:47.970815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1229/2459] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:47 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:47.974855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e59bc-29e1-4e61-9fd2-a879df086f35 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:47.989582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e59bc-29e1-4e61-9fd2-a879df086f35 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:48.068269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ee70-fb3e-4d37-99fa-a134c15fee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:48.068269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ee70-fb3e-4d37-99fa-a134c15fee95 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:48.068269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ee70-fb3e-4d37-99fa-a134c15fee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:48.068269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810ee70-fb3e-4d37-99fa-a134c15fee95 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:48.068739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810ee70-fb3e-4d37-99fa-a134c15fee95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:48.070552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810ee70-fb3e-4d37-99fa-a134c15fee95 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:48.098912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1231/2460] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:47 2022] POST /identity/v3/users => generated 298 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:48.103380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0189ff-d508-43d5-ace6-1c3efa31cf1e admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:48.131737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0189ff-d508-43d5-ace6-1c3efa31cf1e admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:48.143757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630a2e4-24da-4c1c-a4f4-fbc3ee6de191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:48.144610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a2e4-24da-4c1c-a4f4-fbc3ee6de191 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:48.145133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a2e4-24da-4c1c-a4f4-fbc3ee6de191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:48.145555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630a2e4-24da-4c1c-a4f4-fbc3ee6de191 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:48.146362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630a2e4-24da-4c1c-a4f4-fbc3ee6de191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:48.149103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630a2e4-24da-4c1c-a4f4-fbc3ee6de191 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:48.223180 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1230/2461] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:47:48.228550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ee70-fb3e-4d37-99fa-a134c15fee95 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:48.242695 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810ee70-fb3e-4d37-99fa-a134c15fee95 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:48.249121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb153558-86f0-4e04-9e07-22e66d7be8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:48.250264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb153558-86f0-4e04-9e07-22e66d7be8f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:48.250669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb153558-86f0-4e04-9e07-22e66d7be8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:48.250950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb153558-86f0-4e04-9e07-22e66d7be8f9 admin admin] PATH_INFO: `/v3/projects/1d25beea2e6e47e281e2d2cd99534b19/users/51d9893a96b94dd68038481158bc01c6/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:48.279234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb153558-86f0-4e04-9e07-22e66d7be8f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d25beea2e6e47e281e2d2cd99534b19, user_id=51d9893a96b94dd68038481158bc01c6, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:48.280367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb153558-86f0-4e04-9e07-22e66d7be8f9 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:48.307913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1232/2462] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:48 2022] PUT /identity/v3/projects/1d25beea2e6e47e281e2d2cd99534b19/users/51d9893a96b94dd68038481158bc01c6/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:48.312189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630a2e4-24da-4c1c-a4f4-fbc3ee6de191 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:48.340571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630a2e4-24da-4c1c-a4f4-fbc3ee6de191 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:48.472138 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cb560-4e8c-409c-a92f-6b430bbbbca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:48.474857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cb560-4e8c-409c-a92f-6b430bbbbca0 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:48.475192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cb560-4e8c-409c-a92f-6b430bbbbca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:48.475467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cb560-4e8c-409c-a92f-6b430bbbbca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:48.493065 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cb560-4e8c-409c-a92f-6b430bbbbca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:48.499470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cb560-4e8c-409c-a92f-6b430bbbbca0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:48.529306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1231/2463] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:48.533450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb153558-86f0-4e04-9e07-22e66d7be8f9 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:48.550491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb153558-86f0-4e04-9e07-22e66d7be8f9 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:48.561004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:48.562487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:48.562884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:48.563268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] PATH_INFO: `/v3/projects/1d25beea2e6e47e281e2d2cd99534b19/users/51d9893a96b94dd68038481158bc01c6/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:48.567596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d25beea2e6e47e281e2d2cd99534b19, user_id=51d9893a96b94dd68038481158bc01c6, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:48.572495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:48.603500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1233/2464] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:48 2022] PUT /identity/v3/projects/1d25beea2e6e47e281e2d2cd99534b19/users/51d9893a96b94dd68038481158bc01c6/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:48.617483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366ddf9-ea91-4fd5-835a-578b1a2766bf None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:48.617829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366ddf9-ea91-4fd5-835a-578b1a2766bf None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:48.618092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8366ddf9-ea91-4fd5-835a-578b1a2766bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:48.681607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8366ddf9-ea91-4fd5-835a-578b1a2766bf None None] MFA Rules not processed for user `51d9893a96b94dd68038481158bc01c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:48.682864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8366ddf9-ea91-4fd5-835a-578b1a2766bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:48.735396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:48.777144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1232/2465] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:48.789009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:48.791618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:48.887424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982de1c-4279-464f-8591-1bde01ac72a7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:48.891535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6496e-9075-4495-a2e6-12b7ead3633d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:48.892257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6496e-9075-4495-a2e6-12b7ead3633d service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:48.892726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6496e-9075-4495-a2e6-12b7ead3633d service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:48.893111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a6496e-9075-4495-a2e6-12b7ead3633d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:48.938308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:48.985601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6496e-9075-4495-a2e6-12b7ead3633d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:48.987063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a6496e-9075-4495-a2e6-12b7ead3633d service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:48.997729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1234/2466] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:49.371632 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba50ba-62dc-41be-80a1-67024d302d1e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:49.372148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba50ba-62dc-41be-80a1-67024d302d1e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:49.372379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba50ba-62dc-41be-80a1-67024d302d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:49.404820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9bba50ba-62dc-41be-80a1-67024d302d1e None None] MFA Rules not processed for user `2cb4563a03f6449eb5c65bd000d341d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:49.406460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9bba50ba-62dc-41be-80a1-67024d302d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:49.485197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1233/2467] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:50.678336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6496e-9075-4495-a2e6-12b7ead3633d service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:50.689197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a6496e-9075-4495-a2e6-12b7ead3633d service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:50.693779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109ddc0-05e7-4f69-b448-5ebd6ac9a19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:50.694429 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109ddc0-05e7-4f69-b448-5ebd6ac9a19b service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:50.695323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109ddc0-05e7-4f69-b448-5ebd6ac9a19b service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:50.695795 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109ddc0-05e7-4f69-b448-5ebd6ac9a19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:50.761419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109ddc0-05e7-4f69-b448-5ebd6ac9a19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:50.762904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109ddc0-05e7-4f69-b448-5ebd6ac9a19b service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:50.775423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1235/2468] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:51.564265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba50ba-62dc-41be-80a1-67024d302d1e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:51.565949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9bba50ba-62dc-41be-80a1-67024d302d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:51.594397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba50ba-62dc-41be-80a1-67024d302d1e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:51.604621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12deb2f1-f70b-4550-9a92-b4345cd31f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:51.605436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb2f1-f70b-4550-9a92-b4345cd31f8b service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:51.606014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb2f1-f70b-4550-9a92-b4345cd31f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:51.606404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12deb2f1-f70b-4550-9a92-b4345cd31f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:51.618349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deb2f1-f70b-4550-9a92-b4345cd31f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:51.620267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12deb2f1-f70b-4550-9a92-b4345cd31f8b service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:51.642300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1234/2469] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:56.001290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109ddc0-05e7-4f69-b448-5ebd6ac9a19b service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:56.088441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109ddc0-05e7-4f69-b448-5ebd6ac9a19b service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:56.095841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:56.096536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:56.096822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:56.097102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] PATH_INFO: `/v3/users/4187bab415d844728e58ab7a64b4d63a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:56.098275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4187bab415d844728e58ab7a64b4d63a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:56.100237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:56.166642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4187bab415d844728e58ab7a64b4d63a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:56.184451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4187bab415d844728e58ab7a64b4d63a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:56.185506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4187bab415d844728e58ab7a64b4d63a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:56.186372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4187bab415d844728e58ab7a64b4d63a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:56.193013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:56.216489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4187bab415d844728e58ab7a64b4d63a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:56.242174 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1236/2470] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:56 2022] DELETE /identity/v3/users/4187bab415d844728e58ab7a64b4d63a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:56.246685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960dd9-9923-45aa-9280-929d575d75cd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:56.247565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960dd9-9923-45aa-9280-929d575d75cd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:56.248202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960dd9-9923-45aa-9280-929d575d75cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:56.283655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-1d960dd9-9923-45aa-9280-929d575d75cd None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:56.284986 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1d960dd9-9923-45aa-9280-929d575d75cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:56.366702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1235/2471] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:56.383504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:56.385050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:56.462390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97158a54-1d4f-4e8d-a5b8-bd234d234622 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:56.466662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:56.467077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:56.467353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:56.467613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:56.483242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:56.485254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:56.500076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1237/2472] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:57.154155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9f2c-33be-4523-87d8-0e3f0d174a0a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:57.154439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9f2c-33be-4523-87d8-0e3f0d174a0a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:57.154901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db9f2c-33be-4523-87d8-0e3f0d174a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:57.161518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:57.163500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:57.182215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de19af-6a88-45bb-a3c0-bcd57e333a9d service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:57.185149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-c2db9f2c-33be-4523-87d8-0e3f0d174a0a None None] MFA Rules not processed for user `2f4f149b17ac48c4931338cc7b0b2112`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:57.186440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c2db9f2c-33be-4523-87d8-0e3f0d174a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:57.189004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:57.190064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:57.190580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:57.191053 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] PATH_INFO: `/v3/projects/969fcca38b64414abbe6ae0a70fee86a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:57.192501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=969fcca38b64414abbe6ae0a70fee86a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:57.195015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:57.254715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '969fcca38b64414abbe6ae0a70fee86a', 'request_id': 'req-4902290d-1a31-4e33-862e-d372db3a5f8a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.257859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1236/2473] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:57.270815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '969fcca38b64414abbe6ae0a70fee86a', 'request_id': 'req-4902290d-1a31-4e33-862e-d372db3a5f8a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.279008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '969fcca38b64414abbe6ae0a70fee86a', 'request_id': 'req-4902290d-1a31-4e33-862e-d372db3a5f8a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.292705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] The token cache is being invalidate because project 969fcca38b64414abbe6ae0a70fee86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:57.293050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.293691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.297628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1238/2474] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:57 2022] DELETE /identity/v3/projects/969fcca38b64414abbe6ae0a70fee86a => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:47:57.301722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db9f2c-33be-4523-87d8-0e3f0d174a0a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:57.313485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db9f2c-33be-4523-87d8-0e3f0d174a0a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:57.333092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:57.378737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:57.379363 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:57.379835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:57.380367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] PATH_INFO: `/v3/users/4960649b744e4012b0fc365be3445396` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:57.382537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=4960649b744e4012b0fc365be3445396)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:57.385809 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:57.443106 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4960649b744e4012b0fc365be3445396'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.445575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4960649b744e4012b0fc365be3445396'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.455143 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4960649b744e4012b0fc365be3445396'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.468762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4960649b744e4012b0fc365be3445396'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.476762 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4960649b744e4012b0fc365be3445396'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:57.482780 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1237/2475] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:57 2022] DELETE /identity/v3/users/4960649b744e4012b0fc365be3445396 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:57.872879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:57.875754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:57.890702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902290d-1a31-4e33-862e-d372db3a5f8a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:57.958849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:57.959624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:57.960526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:57.960853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] PATH_INFO: `/v3/projects/c93dfe498d99463893bae5726ff011d0` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:57.962108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93dfe498d99463893bae5726ff011d0)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:57.964037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:57.976802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:58.018309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93dfe498d99463893bae5726ff011d0', 'request_id': 'req-e7aade0a-d75d-4f77-8b92-2e15376108bb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.028001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93dfe498d99463893bae5726ff011d0', 'request_id': 'req-e7aade0a-d75d-4f77-8b92-2e15376108bb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.035068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93dfe498d99463893bae5726ff011d0', 'request_id': 'req-e7aade0a-d75d-4f77-8b92-2e15376108bb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.058986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] The token cache is being invalidate because project c93dfe498d99463893bae5726ff011d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:58.059697 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.060489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.062268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1239/2476] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:57 2022] DELETE /identity/v3/projects/c93dfe498d99463893bae5726ff011d0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:58.066202 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:58.067720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:58.082413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5fd1a-5dea-46d2-ac8d-eaea422b48ce admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:58.142154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:58.142791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:58.143073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:58.143347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] PATH_INFO: `/v3/users/51d9893a96b94dd68038481158bc01c6` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:58.144511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d9893a96b94dd68038481158bc01c6)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:58.146455 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:58.185857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:58.197953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d9893a96b94dd68038481158bc01c6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.199221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d9893a96b94dd68038481158bc01c6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.206631 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d9893a96b94dd68038481158bc01c6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.218710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d9893a96b94dd68038481158bc01c6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.225907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9d115fb8-34f7-46b9-bd79-b29bbde07309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d9893a96b94dd68038481158bc01c6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.232031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1238/2477] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:47:58 2022] DELETE /identity/v3/users/51d9893a96b94dd68038481158bc01c6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:58.511434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:58.512967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:58.526224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aade0a-d75d-4f77-8b92-2e15376108bb admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:58.592968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:58.593572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:58.593841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:58.594112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] PATH_INFO: `/v3/projects/1d25beea2e6e47e281e2d2cd99534b19` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:58.595257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d25beea2e6e47e281e2d2cd99534b19)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:58.597216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:58.650172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d25beea2e6e47e281e2d2cd99534b19', 'request_id': 'req-8ae40fe6-0905-49ad-837e-c3e3bfd10654'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.657157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d25beea2e6e47e281e2d2cd99534b19', 'request_id': 'req-8ae40fe6-0905-49ad-837e-c3e3bfd10654'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.664704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d25beea2e6e47e281e2d2cd99534b19', 'request_id': 'req-8ae40fe6-0905-49ad-837e-c3e3bfd10654'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.675766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] The token cache is being invalidate because project 1d25beea2e6e47e281e2d2cd99534b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:47:58.676048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.676882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8ae40fe6-0905-49ad-837e-c3e3bfd10654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:47:58.678538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1240/2478] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:47:58 2022] DELETE /identity/v3/projects/1d25beea2e6e47e281e2d2cd99534b19 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:58.684682 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697595-b6f3-46ae-82fb-0f39ede3086f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:58.685218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697595-b6f3-46ae-82fb-0f39ede3086f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:58.685218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d697595-b6f3-46ae-82fb-0f39ede3086f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:58.705204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4d697595-b6f3-46ae-82fb-0f39ede3086f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:58.706426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4d697595-b6f3-46ae-82fb-0f39ede3086f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:58.768200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1239/2479] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:58.784008 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0bf9b-474f-47a1-9bde-72c6881dbeee None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:58.784317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0bf9b-474f-47a1-9bde-72c6881dbeee None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:58.784594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0bf9b-474f-47a1-9bde-72c6881dbeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:58.805843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-87b0bf9b-474f-47a1-9bde-72c6881dbeee None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:58.807068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-87b0bf9b-474f-47a1-9bde-72c6881dbeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:58.815048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1241/2480] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:58.819400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697595-b6f3-46ae-82fb-0f39ede3086f None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:58.830145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d697595-b6f3-46ae-82fb-0f39ede3086f None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:58.835533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:58.836158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:58.836470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:58.836748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:58.837407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:47:58.837710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:58.839334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:58.852375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1240/2481] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:47:58.857311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0bf9b-474f-47a1-9bde-72c6881dbeee None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:58.866586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0bf9b-474f-47a1-9bde-72c6881dbeee None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:58.871726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace327-0c2e-4000-b52a-6816d5f4b86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:58.872255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace327-0c2e-4000-b52a-6816d5f4b86f admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:58.872539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace327-0c2e-4000-b52a-6816d5f4b86f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:58.872875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ace327-0c2e-4000-b52a-6816d5f4b86f admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:58.873584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ace327-0c2e-4000-b52a-6816d5f4b86f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:58.875761 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ace327-0c2e-4000-b52a-6816d5f4b86f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:58.922293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1242/2482] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:47:58 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:47:58.923576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:58.942549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4203a9a8-7d6e-4b2d-be66-d9a326cfcb90 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:59.009024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2521-cc63-464d-83b8-fa10353c6d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:59.009630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2521-cc63-464d-83b8-fa10353c6d8f admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:59.009912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2521-cc63-464d-83b8-fa10353c6d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:59.010186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e2521-cc63-464d-83b8-fa10353c6d8f admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:59.010825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e2521-cc63-464d-83b8-fa10353c6d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:59.012802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e2521-cc63-464d-83b8-fa10353c6d8f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:59.045411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1241/2483] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:47:58 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:47:59.048534 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace327-0c2e-4000-b52a-6816d5f4b86f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:59.054474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:59.062781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ace327-0c2e-4000-b52a-6816d5f4b86f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:59.070966 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057444c-835c-4d6a-ac1e-16c96dfed93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:59.071582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057444c-835c-4d6a-ac1e-16c96dfed93e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:59.071868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057444c-835c-4d6a-ac1e-16c96dfed93e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:59.072165 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9057444c-835c-4d6a-ac1e-16c96dfed93e admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:59.074514 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057444c-835c-4d6a-ac1e-16c96dfed93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:59.074701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9057444c-835c-4d6a-ac1e-16c96dfed93e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:59.087722 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1243/2484] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:59.091581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2521-cc63-464d-83b8-fa10353c6d8f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:59.103479 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e2521-cc63-464d-83b8-fa10353c6d8f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:59.114330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7fa03a-5ea6-4878-896a-da46f9e7e1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:59.114953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fa03a-5ea6-4878-896a-da46f9e7e1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:59.115235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fa03a-5ea6-4878-896a-da46f9e7e1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:59.115511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7fa03a-5ea6-4878-896a-da46f9e7e1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:59.116256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fa03a-5ea6-4878-896a-da46f9e7e1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:59.118046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7fa03a-5ea6-4878-896a-da46f9e7e1f3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:59.137066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1242/2485] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:47:59.138255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057444c-835c-4d6a-ac1e-16c96dfed93e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:59.149474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9057444c-835c-4d6a-ac1e-16c96dfed93e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:59.154578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:59.155246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:59.155565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:59.155803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] PATH_INFO: `/v3/projects/b3e217ccdbc141319b299384824f636c/users/3f75428f0d654a6e92f084d0eb5468a4/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:59.173962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e217ccdbc141319b299384824f636c, user_id=3f75428f0d654a6e92f084d0eb5468a4, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:59.177028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:59.195633 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1244/2486] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:47:59 2022] PUT /identity/v3/projects/b3e217ccdbc141319b299384824f636c/users/3f75428f0d654a6e92f084d0eb5468a4/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:47:59.200781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8c45-8d8c-4b7c-a802-3744332ffe3c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:59.201073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8c45-8d8c-4b7c-a802-3744332ffe3c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:59.201348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1d8c45-8d8c-4b7c-a802-3744332ffe3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:59.221409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5e1d8c45-8d8c-4b7c-a802-3744332ffe3c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:59.222640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5e1d8c45-8d8c-4b7c-a802-3744332ffe3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:59.237421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:47:59.289342 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1243/2487] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:47:59.300203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:47:59.301944 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:59.361892 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6c784-9fb4-4595-959a-333367d263dd admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:47:59.365481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:47:59.366126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:59.366405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:59.366673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:59.376623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:47:59.378046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:47:59.388778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1245/2488] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:47:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:47:59.878769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0ec7f-3b55-4862-b062-971b86346c42 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:47:59.879734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0ec7f-3b55-4862-b062-971b86346c42 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:47:59.880406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c0ec7f-3b55-4862-b062-971b86346c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:47:59.903313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-40c0ec7f-3b55-4862-b062-971b86346c42 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:47:59.905051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-40c0ec7f-3b55-4862-b062-971b86346c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:47:59.994956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1244/2489] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:47:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:00.013173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:00.014700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:00.119352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca267d67-8aa9-4bbc-92cc-6f235b7e65eb service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:00.125635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:00.126374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:00.126720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:00.127173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:00.141946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:00.143978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:00.154836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1246/2490] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:48:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:48:00.672683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e01c-f20d-4b8b-b4f4-89c0c230482d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:00.672988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e01c-f20d-4b8b-b4f4-89c0c230482d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:00.673293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e01c-f20d-4b8b-b4f4-89c0c230482d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:00.749175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-bf74e01c-f20d-4b8b-b4f4-89c0c230482d None None] MFA Rules not processed for user `3f75428f0d654a6e92f084d0eb5468a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:00.750720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bf74e01c-f20d-4b8b-b4f4-89c0c230482d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:00.941069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1245/2491] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:00.955424 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:00.959061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:01.133302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf95a5-3215-41a4-b00d-ead50bc26a42 service swift] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:01.143906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:01.144630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:01.145024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:01.150666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:01.169704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:01.172558 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:01.190916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1247/2492] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:48:02.781101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c166-03ae-449a-97fb-57d935b751d3 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:02.781713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c166-03ae-449a-97fb-57d935b751d3 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:02.781713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7c166-03ae-449a-97fb-57d935b751d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:02.834245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4dd7c166-03ae-449a-97fb-57d935b751d3 None None] MFA Rules not processed for user `3f75428f0d654a6e92f084d0eb5468a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:02.836510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4dd7c166-03ae-449a-97fb-57d935b751d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:02.846239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1246/2493] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:48:11.186181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:12.818429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=78 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:34.441507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:34.442936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:34.457309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6a069-3768-4444-890f-5adc33148f6e service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:34.461915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:34.462565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:34.462845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:34.463116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] PATH_INFO: `/v3/users/d507b12acddb4cc4ba2d95f58fa58ff8` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:34.464277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d507b12acddb4cc4ba2d95f58fa58ff8)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:34.466321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:34.517229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd507b12acddb4cc4ba2d95f58fa58ff8'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:34.530445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd507b12acddb4cc4ba2d95f58fa58ff8'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:34.531152 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd507b12acddb4cc4ba2d95f58fa58ff8'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:34.531785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd507b12acddb4cc4ba2d95f58fa58ff8'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:34.541163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd507b12acddb4cc4ba2d95f58fa58ff8'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:34.553587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1248/2494] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:48:34 2022] DELETE /identity/v3/users/d507b12acddb4cc4ba2d95f58fa58ff8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:34.558317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6cf2a-cde5-40d6-b060-d09761546802 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:34.558882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6cf2a-cde5-40d6-b060-d09761546802 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:34.560085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6cf2a-cde5-40d6-b060-d09761546802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:34.580498 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2cb6cf2a-cde5-40d6-b060-d09761546802 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:34.581868 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2cb6cf2a-cde5-40d6-b060-d09761546802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:34.647973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1247/2495] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:34.658085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:34.659582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:34.732627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cee948-9e81-474d-895d-2275455ae675 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:34.736299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3156d8-b335-4660-a8e3-fae870e73952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:34.736914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3156d8-b335-4660-a8e3-fae870e73952 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:34.737196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3156d8-b335-4660-a8e3-fae870e73952 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:34.737472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3156d8-b335-4660-a8e3-fae870e73952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:34.747401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3156d8-b335-4660-a8e3-fae870e73952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:34.748975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3156d8-b335-4660-a8e3-fae870e73952 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:34.758726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1249/2496] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:48:35.047407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6cf2a-cde5-40d6-b060-d09761546802 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.050701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2cb6cf2a-cde5-40d6-b060-d09761546802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:35.077225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6cf2a-cde5-40d6-b060-d09761546802 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.083640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.084390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.084675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.084960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] PATH_INFO: `/v3/projects/33bedce3bf8d49aa8bfedeefb883059a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.086102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33bedce3bf8d49aa8bfedeefb883059a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.088104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.145699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bedce3bf8d49aa8bfedeefb883059a', 'request_id': 'req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:35.152516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bedce3bf8d49aa8bfedeefb883059a', 'request_id': 'req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:35.158773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bedce3bf8d49aa8bfedeefb883059a', 'request_id': 'req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:35.169167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] The token cache is being invalidate because project 33bedce3bf8d49aa8bfedeefb883059a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:48:35.169453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:35.170083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1a4afa45-d1d3-4305-b95a-c2dfdcb21103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:35.171553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1248/2497] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:48:35 2022] DELETE /identity/v3/projects/33bedce3bf8d49aa8bfedeefb883059a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:35.176513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44344ca-fcbc-4fad-bea7-7da5f8151f87 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.176904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44344ca-fcbc-4fad-bea7-7da5f8151f87 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.177275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44344ca-fcbc-4fad-bea7-7da5f8151f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.197552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-a44344ca-fcbc-4fad-bea7-7da5f8151f87 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:35.198666 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a44344ca-fcbc-4fad-bea7-7da5f8151f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:35.256669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1250/2498] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:35.265040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1761-0f57-4a96-9898-0fcb9f4c2f33 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.265322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1761-0f57-4a96-9898-0fcb9f4c2f33 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.265594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a1761-0f57-4a96-9898-0fcb9f4c2f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.286069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4e8a1761-0f57-4a96-9898-0fcb9f4c2f33 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:35.287257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4e8a1761-0f57-4a96-9898-0fcb9f4c2f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:35.295876 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1249/2499] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:35.300014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44344ca-fcbc-4fad-bea7-7da5f8151f87 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.309949 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44344ca-fcbc-4fad-bea7-7da5f8151f87 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.314529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.315130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.315414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.315688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.316375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:48:35.316690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.318278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.329906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1251/2500] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:48:35.333993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a1761-0f57-4a96-9898-0fcb9f4c2f33 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.343910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a1761-0f57-4a96-9898-0fcb9f4c2f33 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.348694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f799c39-dfc6-4d7f-85d2-a8182ba35140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.349275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f799c39-dfc6-4d7f-85d2-a8182ba35140 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.349553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f799c39-dfc6-4d7f-85d2-a8182ba35140 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.349821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f799c39-dfc6-4d7f-85d2-a8182ba35140 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.350451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f799c39-dfc6-4d7f-85d2-a8182ba35140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.352370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f799c39-dfc6-4d7f-85d2-a8182ba35140 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.379387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1250/2501] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:48:35 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:48:35.383436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.388744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:35.395071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448ce23-22ed-4d49-a073-02579dcb6f6e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.454330 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc6318-c009-4866-a8a9-173c60a3a4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.454977 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc6318-c009-4866-a8a9-173c60a3a4ed admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.455119 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc6318-c009-4866-a8a9-173c60a3a4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.455386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc6318-c009-4866-a8a9-173c60a3a4ed admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.456022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc6318-c009-4866-a8a9-173c60a3a4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.458046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc6318-c009-4866-a8a9-173c60a3a4ed admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.480718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1252/2502] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:48:35 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:48:35.485423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f799c39-dfc6-4d7f-85d2-a8182ba35140 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.495672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f799c39-dfc6-4d7f-85d2-a8182ba35140 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.500333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30a11a-eecf-4aa9-aa7b-af208acf2857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.500925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30a11a-eecf-4aa9-aa7b-af208acf2857 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.501205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30a11a-eecf-4aa9-aa7b-af208acf2857 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.501475 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30a11a-eecf-4aa9-aa7b-af208acf2857 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.502108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30a11a-eecf-4aa9-aa7b-af208acf2857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.503708 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30a11a-eecf-4aa9-aa7b-af208acf2857 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.513927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1251/2503] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:48:35.517645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc6318-c009-4866-a8a9-173c60a3a4ed admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.527394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc6318-c009-4866-a8a9-173c60a3a4ed admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.532647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032f92f-63a2-4feb-bb76-6498107a4480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.533236 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f92f-63a2-4feb-bb76-6498107a4480 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.533519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f92f-63a2-4feb-bb76-6498107a4480 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.533789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f92f-63a2-4feb-bb76-6498107a4480 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.534420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032f92f-63a2-4feb-bb76-6498107a4480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.536032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032f92f-63a2-4feb-bb76-6498107a4480 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.546850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1253/2504] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:48:35.550824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30a11a-eecf-4aa9-aa7b-af208acf2857 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.560936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30a11a-eecf-4aa9-aa7b-af208acf2857 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.565533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a28a-f4ac-43e5-8719-094921729a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.566163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a28a-f4ac-43e5-8719-094921729a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.566458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a28a-f4ac-43e5-8719-094921729a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.566713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118a28a-f4ac-43e5-8719-094921729a92 admin admin] PATH_INFO: `/v3/projects/c166e2bfe84a481d88907f8b1d2df779/users/a4db01b71b644e3096fd3b015e17320e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.581919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118a28a-f4ac-43e5-8719-094921729a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c166e2bfe84a481d88907f8b1d2df779, user_id=a4db01b71b644e3096fd3b015e17320e, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.584644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118a28a-f4ac-43e5-8719-094921729a92 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.604779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1252/2505] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:48:35 2022] PUT /identity/v3/projects/c166e2bfe84a481d88907f8b1d2df779/users/a4db01b71b644e3096fd3b015e17320e/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:35.618986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024df646-a6d6-4bf5-855e-96035520f433 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.619182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024df646-a6d6-4bf5-855e-96035520f433 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.619450 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024df646-a6d6-4bf5-855e-96035520f433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.653911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-024df646-a6d6-4bf5-855e-96035520f433 None None] MFA Rules not processed for user `a4db01b71b644e3096fd3b015e17320e`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:35.655184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-024df646-a6d6-4bf5-855e-96035520f433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:35.737540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1254/2506] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:35.742078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a28a-f4ac-43e5-8719-094921729a92 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.762958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:35.809211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118a28a-f4ac-43e5-8719-094921729a92 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.814928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5096a0-0f0f-4772-95b4-c43c53bb9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.815825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5096a0-0f0f-4772-95b4-c43c53bb9c19 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.816118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5096a0-0f0f-4772-95b4-c43c53bb9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.816461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5096a0-0f0f-4772-95b4-c43c53bb9c19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.817089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5096a0-0f0f-4772-95b4-c43c53bb9c19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.819047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5096a0-0f0f-4772-95b4-c43c53bb9c19 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.854621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1253/2507] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:48:35 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:48:35.856017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024df646-a6d6-4bf5-855e-96035520f433 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.867738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024df646-a6d6-4bf5-855e-96035520f433 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:35.938813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3258d-bf01-429f-924b-6efef75b958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:35.939431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3258d-bf01-429f-924b-6efef75b958b admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:35.939712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3258d-bf01-429f-924b-6efef75b958b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:35.939987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3258d-bf01-429f-924b-6efef75b958b admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:35.940740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3258d-bf01-429f-924b-6efef75b958b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:35.942700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3258d-bf01-429f-924b-6efef75b958b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:35.972004 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:35.980344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1255/2508] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:48:35 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:48:35.984245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5096a0-0f0f-4772-95b4-c43c53bb9c19 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:35.995510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5096a0-0f0f-4772-95b4-c43c53bb9c19 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.002124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47898a35-aaf5-42f3-ba09-e37844ad0214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.002942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47898a35-aaf5-42f3-ba09-e37844ad0214 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.003391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47898a35-aaf5-42f3-ba09-e37844ad0214 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.003676 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47898a35-aaf5-42f3-ba09-e37844ad0214 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.004377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47898a35-aaf5-42f3-ba09-e37844ad0214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.006017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47898a35-aaf5-42f3-ba09-e37844ad0214 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.019203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1254/2509] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:48:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:48:36.022757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3258d-bf01-429f-924b-6efef75b958b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.047716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3258d-bf01-429f-924b-6efef75b958b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.055173 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f63ce3-021e-4fba-a65f-58a2ccbf22ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.055971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63ce3-021e-4fba-a65f-58a2ccbf22ee admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.056457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63ce3-021e-4fba-a65f-58a2ccbf22ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.056802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f63ce3-021e-4fba-a65f-58a2ccbf22ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.057568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63ce3-021e-4fba-a65f-58a2ccbf22ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.060083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f63ce3-021e-4fba-a65f-58a2ccbf22ee admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.073439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1256/2510] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:48:36.077901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47898a35-aaf5-42f3-ba09-e37844ad0214 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.095349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47898a35-aaf5-42f3-ba09-e37844ad0214 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.100962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ddae7-01e9-4a1c-a92a-0d50c23c71d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.101622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ddae7-01e9-4a1c-a92a-0d50c23c71d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.101927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ddae7-01e9-4a1c-a92a-0d50c23c71d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.102183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ddae7-01e9-4a1c-a92a-0d50c23c71d7 admin admin] PATH_INFO: `/v3/projects/aaff587c2a2b46809c56323e94fe8a28/users/be32f21aebdf4955966c4b8b063ba83a/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.133116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ddae7-01e9-4a1c-a92a-0d50c23c71d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaff587c2a2b46809c56323e94fe8a28, user_id=be32f21aebdf4955966c4b8b063ba83a, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.136857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ddae7-01e9-4a1c-a92a-0d50c23c71d7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.167184 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1255/2511] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:48:36 2022] PUT /identity/v3/projects/aaff587c2a2b46809c56323e94fe8a28/users/be32f21aebdf4955966c4b8b063ba83a/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:36.170392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a864e29-b6f3-4354-96c2-a02c91511a35 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.170746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a864e29-b6f3-4354-96c2-a02c91511a35 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.171114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a864e29-b6f3-4354-96c2-a02c91511a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.235325 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2a864e29-b6f3-4354-96c2-a02c91511a35 None None] MFA Rules not processed for user `be32f21aebdf4955966c4b8b063ba83a`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:36.236589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2a864e29-b6f3-4354-96c2-a02c91511a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:36.353850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1257/2512] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:36.359383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ddae7-01e9-4a1c-a92a-0d50c23c71d7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.453692 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ddae7-01e9-4a1c-a92a-0d50c23c71d7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.459014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410cbe8-7dc7-4d7c-8078-c510b01491c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.459846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410cbe8-7dc7-4d7c-8078-c510b01491c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.459983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410cbe8-7dc7-4d7c-8078-c510b01491c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.460214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410cbe8-7dc7-4d7c-8078-c510b01491c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.461218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410cbe8-7dc7-4d7c-8078-c510b01491c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.464128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410cbe8-7dc7-4d7c-8078-c510b01491c4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.515144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1256/2513] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:48:36 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:48:36.516110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a864e29-b6f3-4354-96c2-a02c91511a35 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.527131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a864e29-b6f3-4354-96c2-a02c91511a35 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.584508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb421e-79f4-4dc7-9fec-ebc520898d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.585112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb421e-79f4-4dc7-9fec-ebc520898d03 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.585389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb421e-79f4-4dc7-9fec-ebc520898d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.585658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb421e-79f4-4dc7-9fec-ebc520898d03 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.586282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb421e-79f4-4dc7-9fec-ebc520898d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.588217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb421e-79f4-4dc7-9fec-ebc520898d03 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.609629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1258/2514] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:48:36 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:48:36.613687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410cbe8-7dc7-4d7c-8078-c510b01491c4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.624740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410cbe8-7dc7-4d7c-8078-c510b01491c4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.629450 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bd040-b667-4a1f-85fd-d9496dfc3f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.630079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bd040-b667-4a1f-85fd-d9496dfc3f57 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.630358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bd040-b667-4a1f-85fd-d9496dfc3f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.630628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bd040-b667-4a1f-85fd-d9496dfc3f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.631268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bd040-b667-4a1f-85fd-d9496dfc3f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.632954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bd040-b667-4a1f-85fd-d9496dfc3f57 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.644099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1257/2515] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:48:36.648079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb421e-79f4-4dc7-9fec-ebc520898d03 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.658636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb421e-79f4-4dc7-9fec-ebc520898d03 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.663307 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61928-6e2b-4905-9af7-5ee5fdb01851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.663955 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61928-6e2b-4905-9af7-5ee5fdb01851 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.664278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61928-6e2b-4905-9af7-5ee5fdb01851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.664555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d61928-6e2b-4905-9af7-5ee5fdb01851 admin admin] PATH_INFO: `/v3/projects/16aef72561114dceb6fab6a12ba42d7c/users/3ae7d50919cc4414a2941409c34da7b5/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.680687 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d61928-6e2b-4905-9af7-5ee5fdb01851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16aef72561114dceb6fab6a12ba42d7c, user_id=3ae7d50919cc4414a2941409c34da7b5, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.683491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d61928-6e2b-4905-9af7-5ee5fdb01851 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.696812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1259/2516] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:48:36 2022] PUT /identity/v3/projects/16aef72561114dceb6fab6a12ba42d7c/users/3ae7d50919cc4414a2941409c34da7b5/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:36.701364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bd040-b667-4a1f-85fd-d9496dfc3f57 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.711304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bd040-b667-4a1f-85fd-d9496dfc3f57 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.751879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:36.768075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16adc6f-e228-485c-b6dd-4f87d440c7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.768712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adc6f-e228-485c-b6dd-4f87d440c7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.768991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adc6f-e228-485c-b6dd-4f87d440c7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.769263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16adc6f-e228-485c-b6dd-4f87d440c7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.769899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16adc6f-e228-485c-b6dd-4f87d440c7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.771496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16adc6f-e228-485c-b6dd-4f87d440c7a0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.781793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1258/2517] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:48:36.786088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61928-6e2b-4905-9af7-5ee5fdb01851 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.797490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d61928-6e2b-4905-9af7-5ee5fdb01851 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:36.802403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:36.803064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.803343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.803618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] PATH_INFO: `/v3/projects/16aef72561114dceb6fab6a12ba42d7c/users/3ae7d50919cc4414a2941409c34da7b5/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.805583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16aef72561114dceb6fab6a12ba42d7c, user_id=3ae7d50919cc4414a2941409c34da7b5, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:36.808614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:36.819616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1260/2518] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:48:36 2022] PUT /identity/v3/projects/16aef72561114dceb6fab6a12ba42d7c/users/3ae7d50919cc4414a2941409c34da7b5/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:36.830787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58b92-b6d1-436b-8329-938b9ec17bec None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:36.831078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58b92-b6d1-436b-8329-938b9ec17bec None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:36.831354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d58b92-b6d1-436b-8329-938b9ec17bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:36.859269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a0d58b92-b6d1-436b-8329-938b9ec17bec None None] MFA Rules not processed for user `3ae7d50919cc4414a2941409c34da7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:36.860539 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a0d58b92-b6d1-436b-8329-938b9ec17bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:36.951722 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1259/2519] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:36.959783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:36.961510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:37.007077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:37.037218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251cb686-fa56-4887-a78d-9fadd0f52a0b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:37.044987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38a1b-c892-47b9-be92-7d4c6ad7db97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:37.045611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38a1b-c892-47b9-be92-7d4c6ad7db97 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:37.045893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38a1b-c892-47b9-be92-7d4c6ad7db97 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:37.046570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f38a1b-c892-47b9-be92-7d4c6ad7db97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:37.115743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f38a1b-c892-47b9-be92-7d4c6ad7db97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:37.117247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f38a1b-c892-47b9-be92-7d4c6ad7db97 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:37.126381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1261/2520] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:48:38.667380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58b92-b6d1-436b-8329-938b9ec17bec None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:38.670034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a0d58b92-b6d1-436b-8329-938b9ec17bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:38.682159 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d58b92-b6d1-436b-8329-938b9ec17bec None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:38.686853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97982796-150b-45db-95c0-2699d399b845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:38.687554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97982796-150b-45db-95c0-2699d399b845 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:38.687898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97982796-150b-45db-95c0-2699d399b845 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:38.688269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97982796-150b-45db-95c0-2699d399b845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:38.746026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97982796-150b-45db-95c0-2699d399b845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:38.748417 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97982796-150b-45db-95c0-2699d399b845 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:38.757244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1260/2521] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:48:39.285963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38a1b-c892-47b9-be92-7d4c6ad7db97 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:39.295476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f38a1b-c892-47b9-be92-7d4c6ad7db97 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:39.299118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8346c4f3-0c16-454b-9278-93f645d4d11c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:39.299721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346c4f3-0c16-454b-9278-93f645d4d11c service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:39.300002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346c4f3-0c16-454b-9278-93f645d4d11c service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:39.300367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8346c4f3-0c16-454b-9278-93f645d4d11c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:39.309638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346c4f3-0c16-454b-9278-93f645d4d11c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:39.311070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8346c4f3-0c16-454b-9278-93f645d4d11c service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:39.320569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1262/2522] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:48:43.263438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97982796-150b-45db-95c0-2699d399b845 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:43.326095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97982796-150b-45db-95c0-2699d399b845 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:43.330513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:43.331164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:43.331444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:43.331746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] PATH_INFO: `/v3/users/a4db01b71b644e3096fd3b015e17320e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:43.332883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4db01b71b644e3096fd3b015e17320e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:43.334824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:43.339298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:43.381403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4db01b71b644e3096fd3b015e17320e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:43.384560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4db01b71b644e3096fd3b015e17320e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:43.392995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4db01b71b644e3096fd3b015e17320e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:43.409079 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4db01b71b644e3096fd3b015e17320e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:43.418023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4db01b71b644e3096fd3b015e17320e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:43.425579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1261/2523] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:48:43 2022] DELETE /identity/v3/users/a4db01b71b644e3096fd3b015e17320e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:43.429920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d5a0b-cc22-48be-9880-44dd04f109ea None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:43.430411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d5a0b-cc22-48be-9880-44dd04f109ea None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:43.430494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d5a0b-cc22-48be-9880-44dd04f109ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:43.459998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3f0d5a0b-cc22-48be-9880-44dd04f109ea None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:43.461857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3f0d5a0b-cc22-48be-9880-44dd04f109ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:43.550914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1263/2524] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:48:43.568994 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:43.570462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:43.662283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46b688-b5e2-4dda-97ea-1a6b4f99c73e admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:43.666425 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925f40f-58e6-4e49-bc10-c0056cbd289c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:43.667085 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925f40f-58e6-4e49-bc10-c0056cbd289c service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:43.667375 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925f40f-58e6-4e49-bc10-c0056cbd289c service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:43.667645 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925f40f-58e6-4e49-bc10-c0056cbd289c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:43.678166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925f40f-58e6-4e49-bc10-c0056cbd289c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:43.679617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925f40f-58e6-4e49-bc10-c0056cbd289c service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:43.690430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1262/2525] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:48:44.266550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d5a0b-cc22-48be-9880-44dd04f109ea None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:44.268540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3f0d5a0b-cc22-48be-9880-44dd04f109ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:44.286763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d5a0b-cc22-48be-9880-44dd04f109ea None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:44.292779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:44.294619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:44.295182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:44.295648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] PATH_INFO: `/v3/projects/c166e2bfe84a481d88907f8b1d2df779` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:44.298085 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c166e2bfe84a481d88907f8b1d2df779)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:44.301278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:44.372537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c166e2bfe84a481d88907f8b1d2df779', 'request_id': 'req-f20857f0-a8e8-4a4a-9801-6e45118592c4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.381796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c166e2bfe84a481d88907f8b1d2df779', 'request_id': 'req-f20857f0-a8e8-4a4a-9801-6e45118592c4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.390965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c166e2bfe84a481d88907f8b1d2df779', 'request_id': 'req-f20857f0-a8e8-4a4a-9801-6e45118592c4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.396879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:44.405355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] The token cache is being invalidate because project c166e2bfe84a481d88907f8b1d2df779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:48:44.405805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.406939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.408825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1264/2526] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:48:44 2022] DELETE /identity/v3/projects/c166e2bfe84a481d88907f8b1d2df779 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:44.412730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925f40f-58e6-4e49-bc10-c0056cbd289c service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:44.427183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925f40f-58e6-4e49-bc10-c0056cbd289c service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:44.500582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:44.501326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:44.501697 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:44.502042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] PATH_INFO: `/v3/users/be32f21aebdf4955966c4b8b063ba83a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:44.503263 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=be32f21aebdf4955966c4b8b063ba83a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:44.505339 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:44.536036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:44.557869 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be32f21aebdf4955966c4b8b063ba83a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.558551 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be32f21aebdf4955966c4b8b063ba83a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.566982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be32f21aebdf4955966c4b8b063ba83a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.582164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be32f21aebdf4955966c4b8b063ba83a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.589304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be32f21aebdf4955966c4b8b063ba83a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:44.596847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1263/2527] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:48:44 2022] DELETE /identity/v3/users/be32f21aebdf4955966c4b8b063ba83a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:44.907062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:44.908567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:44.943171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20857f0-a8e8-4a4a-9801-6e45118592c4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:45.015166 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:45.016589 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:45.017058 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:45.018100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] PATH_INFO: `/v3/projects/aaff587c2a2b46809c56323e94fe8a28` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:45.020163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaff587c2a2b46809c56323e94fe8a28)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:45.022502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:45.101602 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaff587c2a2b46809c56323e94fe8a28', 'request_id': 'req-ab81980a-8137-41d0-9f85-d9c8c120e5d6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.111251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaff587c2a2b46809c56323e94fe8a28', 'request_id': 'req-ab81980a-8137-41d0-9f85-d9c8c120e5d6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.118089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaff587c2a2b46809c56323e94fe8a28', 'request_id': 'req-ab81980a-8137-41d0-9f85-d9c8c120e5d6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.129920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] The token cache is being invalidate because project aaff587c2a2b46809c56323e94fe8a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:48:45.130270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.130858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.144848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1265/2528] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:48:44 2022] DELETE /identity/v3/projects/aaff587c2a2b46809c56323e94fe8a28 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:45.146098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:45.147810 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:45.167467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293b6fb2-eeb3-418b-aa8e-fc61104ef2bf admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:45.231364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:45.232009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:45.232318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:45.232592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] PATH_INFO: `/v3/users/3ae7d50919cc4414a2941409c34da7b5` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:45.233777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ae7d50919cc4414a2941409c34da7b5)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:45.235758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:45.295241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ae7d50919cc4414a2941409c34da7b5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.295919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ae7d50919cc4414a2941409c34da7b5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.303291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ae7d50919cc4414a2941409c34da7b5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.325793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ae7d50919cc4414a2941409c34da7b5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.344649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7d11b807-e66a-401d-9be1-23ab6ccf0a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ae7d50919cc4414a2941409c34da7b5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:45.366496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1264/2529] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:48:45 2022] DELETE /identity/v3/users/3ae7d50919cc4414a2941409c34da7b5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:48:46.261078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:46.261694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:46.294489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab81980a-8137-41d0-9f85-d9c8c120e5d6 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:46.366799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:46.367554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:46.367895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:46.368277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] PATH_INFO: `/v3/projects/16aef72561114dceb6fab6a12ba42d7c` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:46.369508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=16aef72561114dceb6fab6a12ba42d7c)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:46.372278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:46.406106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:46.424963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16aef72561114dceb6fab6a12ba42d7c', 'request_id': 'req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:46.434677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16aef72561114dceb6fab6a12ba42d7c', 'request_id': 'req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:46.441366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16aef72561114dceb6fab6a12ba42d7c', 'request_id': 'req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:46.453673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] The token cache is being invalidate because project 16aef72561114dceb6fab6a12ba42d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:48:46.453673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:46.453673 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9f9b7f1d-062d-4f8d-ba25-854c6e410dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:48:46.460559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1266/2530] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:48:46 2022] DELETE /identity/v3/projects/16aef72561114dceb6fab6a12ba42d7c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:48:46.461537 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b4f0d-e39a-4ad0-a966-a0289f7b7da0 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:46.462018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b4f0d-e39a-4ad0-a966-a0289f7b7da0 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:46.462328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b4f0d-e39a-4ad0-a966-a0289f7b7da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:46.485566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-0b3b4f0d-e39a-4ad0-a966-a0289f7b7da0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:46.487348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0b3b4f0d-e39a-4ad0-a966-a0289f7b7da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:46.510125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:46.554949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1265/2531] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:46.563492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ae28-3e2a-46bd-a9ef-3725f5c9598b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:46.563774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ae28-3e2a-46bd-a9ef-3725f5c9598b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:46.564069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7ae28-3e2a-46bd-a9ef-3725f5c9598b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:46.584768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-2fd7ae28-3e2a-46bd-a9ef-3725f5c9598b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:46.586186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2fd7ae28-3e2a-46bd-a9ef-3725f5c9598b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:46.596202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1267/2532] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:46.600587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b4f0d-e39a-4ad0-a966-a0289f7b7da0 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:46.621374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b4f0d-e39a-4ad0-a966-a0289f7b7da0 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:46.627018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:46.628161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:46.628490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:46.628771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:46.634973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:48:46.636268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:46.638987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:46.672491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1266/2533] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:48:46.677118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7ae28-3e2a-46bd-a9ef-3725f5c9598b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:46.692725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7ae28-3e2a-46bd-a9ef-3725f5c9598b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:46.697885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d77bc0-2654-49da-898d-7e3141057611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:46.698626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77bc0-2654-49da-898d-7e3141057611 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:46.698974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77bc0-2654-49da-898d-7e3141057611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:46.699345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d77bc0-2654-49da-898d-7e3141057611 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:46.700961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d77bc0-2654-49da-898d-7e3141057611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:46.703863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d77bc0-2654-49da-898d-7e3141057611 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:46.753239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1268/2534] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:48:46 2022] POST /identity/v3/projects => generated 369 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:48:46.757601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:46.768364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c02e4-e2d3-4e0a-b66a-caf295662c37 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:46.881264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d8b9d-4961-4ac2-884d-2955b0522c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:46.882751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d8b9d-4961-4ac2-884d-2955b0522c51 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:46.883042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d8b9d-4961-4ac2-884d-2955b0522c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:46.889142 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d8b9d-4961-4ac2-884d-2955b0522c51 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:46.890298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d8b9d-4961-4ac2-884d-2955b0522c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:46.893285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d8b9d-4961-4ac2-884d-2955b0522c51 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:46.922968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1267/2535] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:48:46 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:48:46.928163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d77bc0-2654-49da-898d-7e3141057611 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:46.942399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d77bc0-2654-49da-898d-7e3141057611 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:46.954277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eca70-43a9-4cfb-b13c-6e5bb0fdf31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:46.954900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eca70-43a9-4cfb-b13c-6e5bb0fdf31b admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:46.955189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eca70-43a9-4cfb-b13c-6e5bb0fdf31b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:46.955455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164eca70-43a9-4cfb-b13c-6e5bb0fdf31b admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:46.956110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eca70-43a9-4cfb-b13c-6e5bb0fdf31b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:46.957745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164eca70-43a9-4cfb-b13c-6e5bb0fdf31b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:46.970118 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1269/2536] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:48:46.974252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d8b9d-4961-4ac2-884d-2955b0522c51 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:46.985396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d8b9d-4961-4ac2-884d-2955b0522c51 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:46.990331 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce777f3-c331-482a-b9ad-7572dcbc411e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:46.991055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce777f3-c331-482a-b9ad-7572dcbc411e admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:46.991623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce777f3-c331-482a-b9ad-7572dcbc411e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:46.991990 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce777f3-c331-482a-b9ad-7572dcbc411e admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:46.992756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce777f3-c331-482a-b9ad-7572dcbc411e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:46.994480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce777f3-c331-482a-b9ad-7572dcbc411e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:47.008102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1268/2537] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:48:47.012535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eca70-43a9-4cfb-b13c-6e5bb0fdf31b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:47.024647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164eca70-43a9-4cfb-b13c-6e5bb0fdf31b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:47.030873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:47.031792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:47.032531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:47.032531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] PATH_INFO: `/v3/projects/8769ddc4485c46129faa778f5217bae3/users/1799ad7728494602b2789a98ece6e5e6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:47.072977 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8769ddc4485c46129faa778f5217bae3, user_id=1799ad7728494602b2789a98ece6e5e6, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:47.076246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:47.104218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1270/2538] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:48:47 2022] PUT /identity/v3/projects/8769ddc4485c46129faa778f5217bae3/users/1799ad7728494602b2789a98ece6e5e6/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:48:47.106385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1f934-6286-4786-b915-d6db1d534310 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:47.106677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1f934-6286-4786-b915-d6db1d534310 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:47.106962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb1f934-6286-4786-b915-d6db1d534310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:47.142349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-beb1f934-6286-4786-b915-d6db1d534310 None None] MFA Rules not processed for user `1799ad7728494602b2789a98ece6e5e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:47.143648 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-beb1f934-6286-4786-b915-d6db1d534310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:47.225574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1269/2539] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:48:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:47.238887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:47.241416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:47.304191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02d4f3-7d0e-4a51-b632-1447583ec75a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:47.307991 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c0bf4de3a1442c8b856efbfac436fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:47.308716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:47.309001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:47.309270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:47.317885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:47.319304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:47.329277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1271/2540] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:48:51.523209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313b19-8540-4a32-a1d0-ae4ce45b4bbd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:51.523813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313b19-8540-4a32-a1d0-ae4ce45b4bbd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:51.523813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0313b19-8540-4a32-a1d0-ae4ce45b4bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:51.556795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-f0313b19-8540-4a32-a1d0-ae4ce45b4bbd None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:51.557873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f0313b19-8540-4a32-a1d0-ae4ce45b4bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:51.585852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:51.682126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1270/2541] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:48:51.915849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:51.921142 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:51.956840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313b19-8540-4a32-a1d0-ae4ce45b4bbd None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:51.958286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-f0313b19-8540-4a32-a1d0-ae4ce45b4bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:52.030068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:48:52.062984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be030e-1285-4c49-a794-cfcb3081504a service glance] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:52.069518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d91bf-f313-4732-b3d2-09a963cb3400 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:52.070136 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d91bf-f313-4732-b3d2-09a963cb3400 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:52.070415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d91bf-f313-4732-b3d2-09a963cb3400 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:52.070689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d91bf-f313-4732-b3d2-09a963cb3400 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:52.072598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-231d91bf-f313-4732-b3d2-09a963cb3400 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:52.086030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d91bf-f313-4732-b3d2-09a963cb3400 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:52.087614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d91bf-f313-4732-b3d2-09a963cb3400 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:52.099481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1272/2542] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:48:52.103879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0313b19-8540-4a32-a1d0-ae4ce45b4bbd None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:48:52.110581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:48:52.112389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:52.112389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:52.112389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:52.125167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:48:52.127035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:48:52.139503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1271/2543] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:48:59.773188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69e70-9ec1-4cdf-ac3e-2868df25a4d3 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:48:59.773723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69e70-9ec1-4cdf-ac3e-2868df25a4d3 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:48:59.773822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e69e70-9ec1-4cdf-ac3e-2868df25a4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:48:59.797049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-45e69e70-9ec1-4cdf-ac3e-2868df25a4d3 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:48:59.798264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-45e69e70-9ec1-4cdf-ac3e-2868df25a4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:48:59.806391 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1273/2544] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:48:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:48:59.984685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:48:59.986298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:00.001813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41103b6-5e64-4646-8a7e-900583035084 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:00.007575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dcc5-da10-45a0-a76b-4e1426ef9e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:00.008274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dcc5-da10-45a0-a76b-4e1426ef9e97 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:00.008494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dcc5-da10-45a0-a76b-4e1426ef9e97 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:00.008769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2519dcc5-da10-45a0-a76b-4e1426ef9e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:00.017843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519dcc5-da10-45a0-a76b-4e1426ef9e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:00.019436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2519dcc5-da10-45a0-a76b-4e1426ef9e97 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:00.028870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1272/2545] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:48:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:09.791070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=10 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:10.024642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=58 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:14.605377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568b7f-dcf5-4a32-9c83-895e07fa8a4a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:14.605846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568b7f-dcf5-4a32-9c83-895e07fa8a4a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:14.606050 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568b7f-dcf5-4a32-9c83-895e07fa8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:14.628070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5c568b7f-dcf5-4a32-9c83-895e07fa8a4a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:14.629369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5c568b7f-dcf5-4a32-9c83-895e07fa8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:14.637167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1274/2546] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:14.686996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dcc5-da10-45a0-a76b-4e1426ef9e97 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:14.698438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2519dcc5-da10-45a0-a76b-4e1426ef9e97 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:14.706838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2e6f-172c-4cdb-9a37-1e8983f35877 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:14.709032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2e6f-172c-4cdb-9a37-1e8983f35877 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:14.709316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2e6f-172c-4cdb-9a37-1e8983f35877 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:14.710447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f2e6f-172c-4cdb-9a37-1e8983f35877 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:14.723703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f2e6f-172c-4cdb-9a37-1e8983f35877 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:14.725705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f2e6f-172c-4cdb-9a37-1e8983f35877 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:14.736773 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1273/2547] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:17.725066 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568b7f-dcf5-4a32-9c83-895e07fa8a4a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:17.728804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5c568b7f-dcf5-4a32-9c83-895e07fa8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:17.843250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568b7f-dcf5-4a32-9c83-895e07fa8a4a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:17.848297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf9f1f-283e-4ab4-bbc9-25e78998fd2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:17.849093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9f1f-283e-4ab4-bbc9-25e78998fd2f service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:17.849599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9f1f-283e-4ab4-bbc9-25e78998fd2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:17.850009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9f1f-283e-4ab4-bbc9-25e78998fd2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:17.852326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-52cf9f1f-283e-4ab4-bbc9-25e78998fd2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:17.982592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf9f1f-283e-4ab4-bbc9-25e78998fd2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:17.984519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf9f1f-283e-4ab4-bbc9-25e78998fd2f service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:17.998027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1275/2548] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:17 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:19.044712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2e6f-172c-4cdb-9a37-1e8983f35877 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:19.056703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f2e6f-172c-4cdb-9a37-1e8983f35877 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:19.063685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:19.064364 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:19.064651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:19.064932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] PATH_INFO: `/v3/users/1799ad7728494602b2789a98ece6e5e6` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:19.066086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1799ad7728494602b2789a98ece6e5e6)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:19.068076 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:19.119084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1799ad7728494602b2789a98ece6e5e6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.119772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1799ad7728494602b2789a98ece6e5e6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.131369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1799ad7728494602b2789a98ece6e5e6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.145082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1799ad7728494602b2789a98ece6e5e6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.153517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1799ad7728494602b2789a98ece6e5e6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.164127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1274/2549] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:49:19 2022] DELETE /identity/v3/users/1799ad7728494602b2789a98ece6e5e6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:49:19.166087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34b89-28b5-465b-a8fd-9f22789d3d91 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:19.166592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34b89-28b5-465b-a8fd-9f22789d3d91 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:19.166890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d34b89-28b5-465b-a8fd-9f22789d3d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:19.191620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-53d34b89-28b5-465b-a8fd-9f22789d3d91 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:19.193043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-53d34b89-28b5-465b-a8fd-9f22789d3d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:19.258825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1276/2550] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:49:19.269607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:19.271124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:19.334633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3c391-fc82-46e8-b1f3-15dde0cffb86 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:19.338607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d724c-0473-4439-a810-e195f852dab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:19.339210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d724c-0473-4439-a810-e195f852dab0 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:19.339484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d724c-0473-4439-a810-e195f852dab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:19.339751 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d724c-0473-4439-a810-e195f852dab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:19.351277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d724c-0473-4439-a810-e195f852dab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:19.353071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d724c-0473-4439-a810-e195f852dab0 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:19.365567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1275/2551] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:19.688408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34b89-28b5-465b-a8fd-9f22789d3d91 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:19.690080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-53d34b89-28b5-465b-a8fd-9f22789d3d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:19.703715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d34b89-28b5-465b-a8fd-9f22789d3d91 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:19.709745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:19.710502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:19.710856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:19.711209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] PATH_INFO: `/v3/projects/8769ddc4485c46129faa778f5217bae3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:19.712461 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8769ddc4485c46129faa778f5217bae3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:19.714629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:19.775210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:19.785060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8769ddc4485c46129faa778f5217bae3', 'request_id': 'req-a047d6f0-35b1-4651-b16a-49fc61bc2a17'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.796946 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8769ddc4485c46129faa778f5217bae3', 'request_id': 'req-a047d6f0-35b1-4651-b16a-49fc61bc2a17'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.808781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8769ddc4485c46129faa778f5217bae3', 'request_id': 'req-a047d6f0-35b1-4651-b16a-49fc61bc2a17'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.821691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] The token cache is being invalidate because project 8769ddc4485c46129faa778f5217bae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:49:19.822100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.822772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a047d6f0-35b1-4651-b16a-49fc61bc2a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:19.824546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1277/2552] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:49:19 2022] DELETE /identity/v3/projects/8769ddc4485c46129faa778f5217bae3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:49:19.830186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93521b-bcc4-4f70-bc4a-cec41a3b37a2 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:19.830186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93521b-bcc4-4f70-bc4a-cec41a3b37a2 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:19.830557 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93521b-bcc4-4f70-bc4a-cec41a3b37a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:19.865010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5a93521b-bcc4-4f70-bc4a-cec41a3b37a2 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:19.866488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5a93521b-bcc4-4f70-bc4a-cec41a3b37a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:19.927247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1276/2553] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:19.935485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d351-0e37-43b0-a0d9-e2289cd7750d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:19.935807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d351-0e37-43b0-a0d9-e2289cd7750d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:19.936024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8d351-0e37-43b0-a0d9-e2289cd7750d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:19.963116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-75d8d351-0e37-43b0-a0d9-e2289cd7750d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:19.964468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-75d8d351-0e37-43b0-a0d9-e2289cd7750d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:19.975844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1278/2554] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:19.977715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93521b-bcc4-4f70-bc4a-cec41a3b37a2 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:19.983071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:19.990736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93521b-bcc4-4f70-bc4a-cec41a3b37a2 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:19.998130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:19.998796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:19.999078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:19.999413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:20.000007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:49:20.000345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:20.001987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:20.018891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1277/2555] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:49:20.019987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8d351-0e37-43b0-a0d9-e2289cd7750d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:20.036124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d8d351-0e37-43b0-a0d9-e2289cd7750d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:20.046420 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269647cb-cc8d-4170-be85-72c930a08fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:20.048131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269647cb-cc8d-4170-be85-72c930a08fea admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:20.048131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269647cb-cc8d-4170-be85-72c930a08fea admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:20.048877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269647cb-cc8d-4170-be85-72c930a08fea admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:20.052201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269647cb-cc8d-4170-be85-72c930a08fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:20.056094 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269647cb-cc8d-4170-be85-72c930a08fea admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:20.137046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1279/2556] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:49:20 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:49:20.141817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:20.158171 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d01d1-fe32-4f04-bae0-1f7d92934844 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:20.227197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b23c-599b-4f02-974c-00a807ca2b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:20.227815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b23c-599b-4f02-974c-00a807ca2b17 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:20.228099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b23c-599b-4f02-974c-00a807ca2b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:20.228407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b23c-599b-4f02-974c-00a807ca2b17 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:20.229044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b23c-599b-4f02-974c-00a807ca2b17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:20.231020 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b23c-599b-4f02-974c-00a807ca2b17 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:20.259273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1278/2557] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:49:20 2022] POST /identity/v3/users => generated 282 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:49:20.263535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269647cb-cc8d-4170-be85-72c930a08fea admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:20.274932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269647cb-cc8d-4170-be85-72c930a08fea admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:20.282258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdfd96-a697-4283-9979-81f00dd44e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:20.282956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdfd96-a697-4283-9979-81f00dd44e7f admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:20.283306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdfd96-a697-4283-9979-81f00dd44e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:20.283650 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdfd96-a697-4283-9979-81f00dd44e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:20.285604 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdfd96-a697-4283-9979-81f00dd44e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:20.287319 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bdfd96-a697-4283-9979-81f00dd44e7f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:20.299555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1280/2558] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:49:20.305334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b23c-599b-4f02-974c-00a807ca2b17 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:20.328548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b23c-599b-4f02-974c-00a807ca2b17 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:20.341588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3f130-0ce3-4fd4-8b1d-290577a48b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:20.343165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3f130-0ce3-4fd4-8b1d-290577a48b02 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:20.343703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3f130-0ce3-4fd4-8b1d-290577a48b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:20.344200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3f130-0ce3-4fd4-8b1d-290577a48b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:20.345122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3f130-0ce3-4fd4-8b1d-290577a48b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:20.348233 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3f130-0ce3-4fd4-8b1d-290577a48b02 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:20.372835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdfd96-a697-4283-9979-81f00dd44e7f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:20.383499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1279/2559] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:49:20.392509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdfd96-a697-4283-9979-81f00dd44e7f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:20.412882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:20.413560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:20.414003 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:20.414288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] PATH_INFO: `/v3/projects/8622fcda826b439c9c136e92c016d3b4/users/db8d03c253bb477a9dc14492ef680dfe/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:20.438261 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8622fcda826b439c9c136e92c016d3b4, user_id=db8d03c253bb477a9dc14492ef680dfe, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:20.440974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:20.456531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1281/2560] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:49:20 2022] PUT /identity/v3/projects/8622fcda826b439c9c136e92c016d3b4/users/db8d03c253bb477a9dc14492ef680dfe/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:49:20.469741 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142043-c4d4-4def-bff6-0fced3c78d1c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:20.470238 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142043-c4d4-4def-bff6-0fced3c78d1c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:20.470636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142043-c4d4-4def-bff6-0fced3c78d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:20.516042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-97142043-c4d4-4def-bff6-0fced3c78d1c None None] MFA Rules not processed for user `db8d03c253bb477a9dc14492ef680dfe`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:20.517723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-97142043-c4d4-4def-bff6-0fced3c78d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:20.610470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1280/2561] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:49:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:20.623456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:20.625508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:20.717851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8649ca0a-96d6-4e96-b226-7c6fd9987255 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:20.724279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b26784-7e27-4ec5-aa2f-73458ec075cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:20.725046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26784-7e27-4ec5-aa2f-73458ec075cb service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:20.725477 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26784-7e27-4ec5-aa2f-73458ec075cb service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:20.725854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b26784-7e27-4ec5-aa2f-73458ec075cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:20.737390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b26784-7e27-4ec5-aa2f-73458ec075cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:20.739808 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b26784-7e27-4ec5-aa2f-73458ec075cb service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:20.754178 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1282/2562] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:22.860540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327cd1b-bd87-4b53-822b-83b66b705c92 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:22.861899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327cd1b-bd87-4b53-822b-83b66b705c92 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:22.862723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327cd1b-bd87-4b53-822b-83b66b705c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:22.872768 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bda7b-72fc-453f-9e23-94b5fa082f86 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:22.874973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bda7b-72fc-453f-9e23-94b5fa082f86 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:22.875573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bda7b-72fc-453f-9e23-94b5fa082f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:22.914077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-050bda7b-72fc-453f-9e23-94b5fa082f86 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:22.916572 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-050bda7b-72fc-453f-9e23-94b5fa082f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:22.943858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3327cd1b-bd87-4b53-822b-83b66b705c92 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:22.945174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3327cd1b-bd87-4b53-822b-83b66b705c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:23.067628 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1281/2563] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:49:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:23.085858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1283/2564] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:49:23.129336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327cd1b-bd87-4b53-822b-83b66b705c92 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:23.131562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3327cd1b-bd87-4b53-822b-83b66b705c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:23.139060 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:23.191901 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bda7b-72fc-453f-9e23-94b5fa082f86 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:23.194526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-050bda7b-72fc-453f-9e23-94b5fa082f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:23.215057 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:23.299357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327cd1b-bd87-4b53-822b-83b66b705c92 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:23.305962 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:23.306675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:23.307024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:23.307339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bda7b-72fc-453f-9e23-94b5fa082f86 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:23.307458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:23.313985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ccfd0-8078-4b48-8d50-b103cd7569da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:23.314606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ccfd0-8078-4b48-8d50-b103cd7569da service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:23.315720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ccfd0-8078-4b48-8d50-b103cd7569da service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:23.316062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ccfd0-8078-4b48-8d50-b103cd7569da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:23.317909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:23.320205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:23.330839 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1282/2565] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:49:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:23.341766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ad1ccfd0-8078-4b48-8d50-b103cd7569da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:23.447838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:23.449243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:23.517846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ccfd0-8078-4b48-8d50-b103cd7569da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:23.518536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ccfd0-8078-4b48-8d50-b103cd7569da service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:23.559226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1284/2566] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:23.658366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e784060-f820-44ad-9233-b0de7e44f90a service swift] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:23.673259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746e7d3-5cdd-4b81-8f6f-36fd808c5ed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:23.674858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e7d3-5cdd-4b81-8f6f-36fd808c5ed5 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:23.675787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e7d3-5cdd-4b81-8f6f-36fd808c5ed5 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:23.678165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4746e7d3-5cdd-4b81-8f6f-36fd808c5ed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:23.694603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746e7d3-5cdd-4b81-8f6f-36fd808c5ed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:23.696910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4746e7d3-5cdd-4b81-8f6f-36fd808c5ed5 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:23.719703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1283/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:24.197408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7fd96-5e31-410b-9faa-b0bd9c2a9b97 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:24.198209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7fd96-5e31-410b-9faa-b0bd9c2a9b97 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:24.198495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7fd96-5e31-410b-9faa-b0bd9c2a9b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:24.222606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5ea7fd96-5e31-410b-9faa-b0bd9c2a9b97 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:24.223950 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5ea7fd96-5e31-410b-9faa-b0bd9c2a9b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:24.234361 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1285/2568] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 31 09:49:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:24.247928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746e7d3-5cdd-4b81-8f6f-36fd808c5ed5 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:24.260181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4746e7d3-5cdd-4b81-8f6f-36fd808c5ed5 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:24.267057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa108c-6c7a-4f18-b226-93325c82c928 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:24.267616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa108c-6c7a-4f18-b226-93325c82c928 service swift] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:24.268066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa108c-6c7a-4f18-b226-93325c82c928 service swift] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:24.268212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa108c-6c7a-4f18-b226-93325c82c928 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:24.278283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa108c-6c7a-4f18-b226-93325c82c928 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:24.280272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa108c-6c7a-4f18-b226-93325c82c928 service swift] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:24.289369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1284/2569] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:24.420041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae9b8-47ec-44da-9889-e9fd6563b807 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:24.420472 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae9b8-47ec-44da-9889-e9fd6563b807 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:24.420636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ae9b8-47ec-44da-9889-e9fd6563b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:24.441642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-8f0ae9b8-47ec-44da-9889-e9fd6563b807 None None] MFA Rules not processed for user `3f75428f0d654a6e92f084d0eb5468a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:24.443527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8f0ae9b8-47ec-44da-9889-e9fd6563b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:24.514843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1286/2570] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:49:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:24.558441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579f263-5059-454f-862d-8ff0d893ab0f None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:24.558934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579f263-5059-454f-862d-8ff0d893ab0f None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:24.559509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8579f263-5059-454f-862d-8ff0d893ab0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:24.581670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8579f263-5059-454f-862d-8ff0d893ab0f None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:24.582983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8579f263-5059-454f-862d-8ff0d893ab0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:24.591892 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1285/2571] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:49:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:24.605092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae9b8-47ec-44da-9889-e9fd6563b807 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:24.618141 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ae9b8-47ec-44da-9889-e9fd6563b807 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:24.623599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a429-5a12-4b5f-8921-b928274a4615 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:24.624264 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a429-5a12-4b5f-8921-b928274a4615 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:24.624556 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a429-5a12-4b5f-8921-b928274a4615 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:24.624836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b272a429-5a12-4b5f-8921-b928274a4615 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:24.633770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272a429-5a12-4b5f-8921-b928274a4615 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:24.635442 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b272a429-5a12-4b5f-8921-b928274a4615 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:24.645550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1287/2572] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:49:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:25.015118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccd2b8-1627-4130-8f2c-f10132b64213 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:25.015703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccd2b8-1627-4130-8f2c-f10132b64213 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:25.016116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccd2b8-1627-4130-8f2c-f10132b64213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:25.036357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-65ccd2b8-1627-4130-8f2c-f10132b64213 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:25.037814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-65ccd2b8-1627-4130-8f2c-f10132b64213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:25.054690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1286/2573] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 31 09:49:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:25.060767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a429-5a12-4b5f-8921-b928274a4615 service swift] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:25.074167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b272a429-5a12-4b5f-8921-b928274a4615 service swift] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:25.081397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b5638-6daa-4baa-88fe-b52e1a34bb73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:25.081397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b5638-6daa-4baa-88fe-b52e1a34bb73 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:25.081397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b5638-6daa-4baa-88fe-b52e1a34bb73 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:25.081786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b5638-6daa-4baa-88fe-b52e1a34bb73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:25.092437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b5638-6daa-4baa-88fe-b52e1a34bb73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:25.094027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b5638-6daa-4baa-88fe-b52e1a34bb73 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:25.104247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1288/2574] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:49:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:49:27.822128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccd2b8-1627-4130-8f2c-f10132b64213 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:27.825334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-65ccd2b8-1627-4130-8f2c-f10132b64213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:27.839750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccd2b8-1627-4130-8f2c-f10132b64213 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:27.845023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:27.845649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:27.845928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:27.846203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] PATH_INFO: `/v3/users/dd22110f6b0f48a7af4c4645ae9c7e2a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:27.847350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd22110f6b0f48a7af4c4645ae9c7e2a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:27.849397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:27.925176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:27.926955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd22110f6b0f48a7af4c4645ae9c7e2a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:27.928033 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd22110f6b0f48a7af4c4645ae9c7e2a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:27.939038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd22110f6b0f48a7af4c4645ae9c7e2a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:27.957978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd22110f6b0f48a7af4c4645ae9c7e2a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:27.965922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd22110f6b0f48a7af4c4645ae9c7e2a'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:27.972096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1287/2575] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:49:27 2022] DELETE /identity/v3/users/dd22110f6b0f48a7af4c4645ae9c7e2a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:49:27.976590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880152bd-de56-4a16-8c89-4065ba1559d9 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:27.977088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880152bd-de56-4a16-8c89-4065ba1559d9 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:27.977199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880152bd-de56-4a16-8c89-4065ba1559d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:27.996963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-880152bd-de56-4a16-8c89-4065ba1559d9 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:27.998446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-880152bd-de56-4a16-8c89-4065ba1559d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:28.026561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:28.092497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1289/2576] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:28.102096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:28.104283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:28.220766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68763ffe-b60f-499d-952d-f1a51b2dd94f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:28.228044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:28.228724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:28.229010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:28.229284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:28.239728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:28.241290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:28.253720 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1288/2577] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:28.324296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb5646-181e-4b39-8bad-e29d5a6ee639 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:28.324500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb5646-181e-4b39-8bad-e29d5a6ee639 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:28.325692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb5646-181e-4b39-8bad-e29d5a6ee639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:28.348548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4fcb5646-181e-4b39-8bad-e29d5a6ee639 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:28.349786 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4fcb5646-181e-4b39-8bad-e29d5a6ee639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:28.359258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1290/2578] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:28.403719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:28.405553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:28.454501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb5646-181e-4b39-8bad-e29d5a6ee639 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:28.456529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4fcb5646-181e-4b39-8bad-e29d5a6ee639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:28.475029 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb5646-181e-4b39-8bad-e29d5a6ee639 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:28.490134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:28.490945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:28.491436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:28.505376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] PATH_INFO: `/v3/projects/2c305b0064b048dd9ec6d3e8b6fd5da1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:28.507540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c305b0064b048dd9ec6d3e8b6fd5da1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:28.510754 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:28.570083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0a7974-4e51-4e94-90e7-2921f96833ad service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:28.581782 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c305b0064b048dd9ec6d3e8b6fd5da1', 'request_id': 'req-afe3ddb5-32ef-43bf-bff1-847e867251b3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:28.595800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c305b0064b048dd9ec6d3e8b6fd5da1', 'request_id': 'req-afe3ddb5-32ef-43bf-bff1-847e867251b3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:28.605393 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c305b0064b048dd9ec6d3e8b6fd5da1', 'request_id': 'req-afe3ddb5-32ef-43bf-bff1-847e867251b3'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:28.619084 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] The token cache is being invalidate because project 2c305b0064b048dd9ec6d3e8b6fd5da1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:49:28.619523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:28.620853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-afe3ddb5-32ef-43bf-bff1-847e867251b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:49:28.623767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1291/2579] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:49:28 2022] DELETE /identity/v3/projects/2c305b0064b048dd9ec6d3e8b6fd5da1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:49:28.663358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:28.675984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:28.676921 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:28.677564 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:28.678325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:28.680960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:28.769333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:28.771658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:28.789668 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1289/2580] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:32.544753 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29564-71bd-40de-92f3-009c53d88108 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:32.545241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29564-71bd-40de-92f3-009c53d88108 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:32.545374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe29564-71bd-40de-92f3-009c53d88108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:32.565387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-afe29564-71bd-40de-92f3-009c53d88108 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:32.566931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-afe29564-71bd-40de-92f3-009c53d88108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:32.575996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1292/2581] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:32.610172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:32.611622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:32.625885 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5dd2e-ef9d-4b4e-92e7-c638519ab6a1 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:32.631380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:32.632005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:32.632322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:32.632598 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:32.641366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:32.642954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:32.652436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1290/2582] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:49:42.560093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:42.648277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=35 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:49:57.523456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8a0fa-76a0-434b-a6ab-336addc43cb8 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:57.523948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8a0fa-76a0-434b-a6ab-336addc43cb8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:57.524379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8a0fa-76a0-434b-a6ab-336addc43cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:57.547071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-09f8a0fa-76a0-434b-a6ab-336addc43cb8 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:57.548651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-09f8a0fa-76a0-434b-a6ab-336addc43cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:57.619148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1293/2583] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:49:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:49:57.632709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:49:57.634320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:57.730825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3346b7ab-74c5-42cb-8204-b980ccba09a6 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:49:57.740514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:49:57.741239 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:57.741663 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:57.742029 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:57.757481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:49:57.759198 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:49:57.768786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1291/2584] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:49:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 09:49:58.900788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87dd7f-daea-447a-a46c-a47fcde183da None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:49:58.901374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87dd7f-daea-447a-a46c-a47fcde183da None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:49:58.901374 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87dd7f-daea-447a-a46c-a47fcde183da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:49:58.923667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ea87dd7f-daea-447a-a46c-a47fcde183da None None] MFA Rules not processed for user `17c8209074544082a26183b7d8e122f6`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:49:58.925313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ea87dd7f-daea-447a-a46c-a47fcde183da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:49:59.028151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1294/2585] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:49:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:02.502561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:02.504463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:02.523039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aff3c-2c95-4813-81ec-bdbbcec869d1 service swift] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:02.545235 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:02.547586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:02.548105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:02.548739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] PATH_INFO: `/v3/users/db8d03c253bb477a9dc14492ef680dfe` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:02.550219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db8d03c253bb477a9dc14492ef680dfe)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:02.552422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:02.651465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db8d03c253bb477a9dc14492ef680dfe'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:02.655620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db8d03c253bb477a9dc14492ef680dfe'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:02.675254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db8d03c253bb477a9dc14492ef680dfe'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:02.709126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db8d03c253bb477a9dc14492ef680dfe'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:02.721084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db8d03c253bb477a9dc14492ef680dfe'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:02.744062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1292/2586] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:50:02 2022] DELETE /identity/v3/users/db8d03c253bb477a9dc14492ef680dfe => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:50:02.749323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec95c-dcf7-4455-8643-bf03cdd6aa0b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:02.750398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec95c-dcf7-4455-8643-bf03cdd6aa0b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:02.750838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ec95c-dcf7-4455-8643-bf03cdd6aa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:02.785407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f14ec95c-dcf7-4455-8643-bf03cdd6aa0b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:02.798821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f14ec95c-dcf7-4455-8643-bf03cdd6aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:02.940963 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1295/2587] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:02.969048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:02.971588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:03.100873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1179878-c998-447b-8d0f-aa8463f28a8b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:03.106382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e272d-786b-4ba7-9b51-03a47f6bef48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:03.107854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e272d-786b-4ba7-9b51-03a47f6bef48 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:03.108912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e272d-786b-4ba7-9b51-03a47f6bef48 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:03.109613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e272d-786b-4ba7-9b51-03a47f6bef48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:03.138098 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e272d-786b-4ba7-9b51-03a47f6bef48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:03.143999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e272d-786b-4ba7-9b51-03a47f6bef48 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:03.182505 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1293/2588] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:03.657002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ec95c-dcf7-4455-8643-bf03cdd6aa0b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:03.658757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f14ec95c-dcf7-4455-8643-bf03cdd6aa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:03.683009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ec95c-dcf7-4455-8643-bf03cdd6aa0b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:03.696800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:03.697452 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:03.697845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:03.697998 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] PATH_INFO: `/v3/projects/8622fcda826b439c9c136e92c016d3b4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:03.705021 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8622fcda826b439c9c136e92c016d3b4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:03.706959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:03.781195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:03.788310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8622fcda826b439c9c136e92c016d3b4', 'request_id': 'req-538a4dcc-19ab-463a-b609-4e8851bd96ce'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:03.805017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8622fcda826b439c9c136e92c016d3b4', 'request_id': 'req-538a4dcc-19ab-463a-b609-4e8851bd96ce'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:03.818641 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8622fcda826b439c9c136e92c016d3b4', 'request_id': 'req-538a4dcc-19ab-463a-b609-4e8851bd96ce'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:03.843506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] The token cache is being invalidate because project 8622fcda826b439c9c136e92c016d3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:50:03.850303 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:03.852425 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-538a4dcc-19ab-463a-b609-4e8851bd96ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:03.855986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1296/2589] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:50:03 2022] DELETE /identity/v3/projects/8622fcda826b439c9c136e92c016d3b4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:50:03.861998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4d92-8b11-4d18-af01-c42d6ae57225 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:03.862563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4d92-8b11-4d18-af01-c42d6ae57225 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:03.862563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4d92-8b11-4d18-af01-c42d6ae57225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:03.879991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:03.911269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2d8c4d92-8b11-4d18-af01-c42d6ae57225 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:03.912863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2d8c4d92-8b11-4d18-af01-c42d6ae57225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:04.022574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1294/2590] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:04.025268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbee5d-dded-4cd9-88b7-388e8ff59fb1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:04.025743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbee5d-dded-4cd9-88b7-388e8ff59fb1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:04.026177 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbee5d-dded-4cd9-88b7-388e8ff59fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:04.068381 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-65cbee5d-dded-4cd9-88b7-388e8ff59fb1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:04.069724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-65cbee5d-dded-4cd9-88b7-388e8ff59fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:04.094346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1297/2591] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:04.098856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4d92-8b11-4d18-af01-c42d6ae57225 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:04.123503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4d92-8b11-4d18-af01-c42d6ae57225 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:04.143604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:04.144925 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:04.145509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:04.146347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:04.148814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:50:04.150205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:04.151861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:04.173796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1295/2592] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:50:04.177805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbee5d-dded-4cd9-88b7-388e8ff59fb1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:04.196730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbee5d-dded-4cd9-88b7-388e8ff59fb1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:04.213417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da011264-a932-4271-875d-67e0a2075a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:04.214495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011264-a932-4271-875d-67e0a2075a96 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:04.214988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011264-a932-4271-875d-67e0a2075a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:04.215635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da011264-a932-4271-875d-67e0a2075a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:04.216584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da011264-a932-4271-875d-67e0a2075a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:04.220208 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da011264-a932-4271-875d-67e0a2075a96 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:04.274294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1298/2593] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:50:04 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:50:04.278214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:04.315739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611d329-0c37-41d4-a52c-49386da313bc admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:04.394971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22cb7-e2d5-479b-acd1-e28f33c2cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:04.396122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22cb7-e2d5-479b-acd1-e28f33c2cda0 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:04.396565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22cb7-e2d5-479b-acd1-e28f33c2cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:04.397089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc22cb7-e2d5-479b-acd1-e28f33c2cda0 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:04.397937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc22cb7-e2d5-479b-acd1-e28f33c2cda0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:04.400062 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc22cb7-e2d5-479b-acd1-e28f33c2cda0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:04.450421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1296/2594] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:50:04 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:50:04.455217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da011264-a932-4271-875d-67e0a2075a96 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:04.475065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da011264-a932-4271-875d-67e0a2075a96 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:04.486757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a534ee-21cb-486c-8ffe-77ae1df75830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:04.487777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a534ee-21cb-486c-8ffe-77ae1df75830 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:04.489247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a534ee-21cb-486c-8ffe-77ae1df75830 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:04.495124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a534ee-21cb-486c-8ffe-77ae1df75830 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:04.496885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a534ee-21cb-486c-8ffe-77ae1df75830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:04.498930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a534ee-21cb-486c-8ffe-77ae1df75830 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:04.524278 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1299/2595] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:50:04.528781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22cb7-e2d5-479b-acd1-e28f33c2cda0 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:04.561763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc22cb7-e2d5-479b-acd1-e28f33c2cda0 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:04.573892 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c21ebe-86db-4e28-87c9-191e6326c053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:04.574807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21ebe-86db-4e28-87c9-191e6326c053 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:04.575187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21ebe-86db-4e28-87c9-191e6326c053 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:04.575568 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c21ebe-86db-4e28-87c9-191e6326c053 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:04.576402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c21ebe-86db-4e28-87c9-191e6326c053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:04.578256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c21ebe-86db-4e28-87c9-191e6326c053 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:04.601646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1297/2596] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:50:04.607067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a534ee-21cb-486c-8ffe-77ae1df75830 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:04.622713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a534ee-21cb-486c-8ffe-77ae1df75830 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:04.634348 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:04.635030 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:04.635308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:04.635581 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] PATH_INFO: `/v3/projects/a64e8453e6d34397becf13e37caabecf/users/d738cd2a614f4c8baf1534b6efe9ca23/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:04.679690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64e8453e6d34397becf13e37caabecf, user_id=d738cd2a614f4c8baf1534b6efe9ca23, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:04.683494 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:04.715843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1300/2597] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:50:04 2022] PUT /identity/v3/projects/a64e8453e6d34397becf13e37caabecf/users/d738cd2a614f4c8baf1534b6efe9ca23/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:50:04.799324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8b42-29d3-459e-be1e-7b746faa0c00 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:04.799614 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8b42-29d3-459e-be1e-7b746faa0c00 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:04.799897 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e8b42-29d3-459e-be1e-7b746faa0c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:04.834280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-ba0e8b42-29d3-459e-be1e-7b746faa0c00 None None] MFA Rules not processed for user `d738cd2a614f4c8baf1534b6efe9ca23`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:04.835444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ba0e8b42-29d3-459e-be1e-7b746faa0c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:04.918959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:04.923474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1298/2598] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:50:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:04.934037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:04.936311 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:05.024725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b891b157-fe7b-4724-aefd-dcb58462db0c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:05.028308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f509f-8216-4329-9524-1d4a54a59ef2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:05.028973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f509f-8216-4329-9524-1d4a54a59ef2 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:05.029298 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f509f-8216-4329-9524-1d4a54a59ef2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:05.029522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f509f-8216-4329-9524-1d4a54a59ef2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:05.038867 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f509f-8216-4329-9524-1d4a54a59ef2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:05.040777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f509f-8216-4329-9524-1d4a54a59ef2 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:05.052964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1301/2599] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:15.048444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:15.853922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8b42-29d3-459e-be1e-7b746faa0c00 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:15.920371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e8b42-29d3-459e-be1e-7b746faa0c00 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:15.927181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:15.927902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:15.928204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:15.928477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] PATH_INFO: `/v3/users/d738cd2a614f4c8baf1534b6efe9ca23` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:15.929681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d738cd2a614f4c8baf1534b6efe9ca23)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:15.931756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:15.983709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd738cd2a614f4c8baf1534b6efe9ca23'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:15.984387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd738cd2a614f4c8baf1534b6efe9ca23'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:15.992946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd738cd2a614f4c8baf1534b6efe9ca23'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:16.007851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd738cd2a614f4c8baf1534b6efe9ca23'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:16.014655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd738cd2a614f4c8baf1534b6efe9ca23'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:16.021063 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1299/2600] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:50:15 2022] DELETE /identity/v3/users/d738cd2a614f4c8baf1534b6efe9ca23 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:50:16.025835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c6f4-160c-499a-8835-4b7e408916ad None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:16.025835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c6f4-160c-499a-8835-4b7e408916ad None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:16.026087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851c6f4-160c-499a-8835-4b7e408916ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:16.045495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5851c6f4-160c-499a-8835-4b7e408916ad None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:16.046699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5851c6f4-160c-499a-8835-4b7e408916ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:16.107390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1302/2601] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:16.118514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:16.120129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:16.178900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e605427-589a-466e-b790-23ffc00906cf admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:16.182853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:16.183404 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:16.183687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:16.183960 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:16.194811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:16.196302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:16.206401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1300/2602] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:16.363355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c2610-ccaf-46f7-ba59-9575d403f340 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:16.363355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c2610-ccaf-46f7-ba59-9575d403f340 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:16.363355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c2610-ccaf-46f7-ba59-9575d403f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:16.383618 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4e7c2610-ccaf-46f7-ba59-9575d403f340 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:16.384879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4e7c2610-ccaf-46f7-ba59-9575d403f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:16.442866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1303/2603] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 31 09:50:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:16.455796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:16.457400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:16.484222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:16.487923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c2610-ccaf-46f7-ba59-9575d403f340 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:16.489390 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4e7c2610-ccaf-46f7-ba59-9575d403f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:16.509846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c2610-ccaf-46f7-ba59-9575d403f340 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:16.514821 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:16.515465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:16.515643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:16.516582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] PATH_INFO: `/v3/projects/a64e8453e6d34397becf13e37caabecf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:16.517974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64e8453e6d34397becf13e37caabecf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:16.519836 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:16.538163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f69a4c6-f3ca-4411-babc-42f168deb79b service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:16.543955 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7201606d-0c5c-4415-ab95-3d6312e56ae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:16.544603 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201606d-0c5c-4415-ab95-3d6312e56ae1 service swift] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:16.544887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201606d-0c5c-4415-ab95-3d6312e56ae1 service swift] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:16.545274 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7201606d-0c5c-4415-ab95-3d6312e56ae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:16.555669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201606d-0c5c-4415-ab95-3d6312e56ae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:16.557320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7201606d-0c5c-4415-ab95-3d6312e56ae1 service swift] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:16.566211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1301/2604] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:50:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:50:16.570989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64e8453e6d34397becf13e37caabecf', 'request_id': 'req-f581420f-8d44-4d39-90af-fff013da4b5c'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:16.579408 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64e8453e6d34397becf13e37caabecf', 'request_id': 'req-f581420f-8d44-4d39-90af-fff013da4b5c'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:16.586131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64e8453e6d34397becf13e37caabecf', 'request_id': 'req-f581420f-8d44-4d39-90af-fff013da4b5c'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:16.598187 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] The token cache is being invalidate because project a64e8453e6d34397becf13e37caabecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:50:16.598553 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:16.599310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:16.601048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1304/2605] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:50:16 2022] DELETE /identity/v3/projects/a64e8453e6d34397becf13e37caabecf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:50:18.443613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082bb48-91d9-4424-be08-1d187cc8f2f6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:18.444538 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082bb48-91d9-4424-be08-1d187cc8f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:18.444835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082bb48-91d9-4424-be08-1d187cc8f2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:18.465147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2082bb48-91d9-4424-be08-1d187cc8f2f6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:18.466352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2082bb48-91d9-4424-be08-1d187cc8f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:18.528742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1302/2606] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:18.549788 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:18.551387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:18.586818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:18.623473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082bb48-91d9-4424-be08-1d187cc8f2f6 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:18.624939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2082bb48-91d9-4424-be08-1d187cc8f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:18.640898 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082bb48-91d9-4424-be08-1d187cc8f2f6 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:18.644088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581420f-8d44-4d39-90af-fff013da4b5c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:18.646474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:18.647105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:18.647390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:18.647666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] PATH_INFO: `/v3/users/3f75428f0d654a6e92f084d0eb5468a4` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:18.649334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f75428f0d654a6e92f084d0eb5468a4)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:18.649628 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfba32a-e211-482f-8a42-4d9fcb37be07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:18.650233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba32a-e211-482f-8a42-4d9fcb37be07 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:18.650512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba32a-e211-482f-8a42-4d9fcb37be07 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:18.650781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfba32a-e211-482f-8a42-4d9fcb37be07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:18.652966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:18.659487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfba32a-e211-482f-8a42-4d9fcb37be07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:18.661120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfba32a-e211-482f-8a42-4d9fcb37be07 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:18.671688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1305/2607] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:18.713468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f75428f0d654a6e92f084d0eb5468a4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:18.714144 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f75428f0d654a6e92f084d0eb5468a4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:18.722383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f75428f0d654a6e92f084d0eb5468a4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:18.734705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f75428f0d654a6e92f084d0eb5468a4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:18.742637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-4337d3d7-0155-48c3-a3c3-99c1b0abfc65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f75428f0d654a6e92f084d0eb5468a4'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:18.749932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1303/2608] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:50:18 2022] DELETE /identity/v3/users/3f75428f0d654a6e92f084d0eb5468a4 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:50:18.926543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfba32a-e211-482f-8a42-4d9fcb37be07 service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:18.936971 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfba32a-e211-482f-8a42-4d9fcb37be07 service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:18.995026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:18.995653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:18.995929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:18.996222 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] PATH_INFO: `/v3/projects/b3e217ccdbc141319b299384824f636c` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:18.997395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e217ccdbc141319b299384824f636c)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:18.999324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:19.044876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e217ccdbc141319b299384824f636c', 'request_id': 'req-5946114c-b284-48a4-afa1-5a3c873bcff6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:19.052930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e217ccdbc141319b299384824f636c', 'request_id': 'req-5946114c-b284-48a4-afa1-5a3c873bcff6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:19.059145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e217ccdbc141319b299384824f636c', 'request_id': 'req-5946114c-b284-48a4-afa1-5a3c873bcff6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:19.069314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] The token cache is being invalidate because project b3e217ccdbc141319b299384824f636c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:50:19.069600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:19.070247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:50:19.071732 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1306/2609] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:50:18 2022] DELETE /identity/v3/projects/b3e217ccdbc141319b299384824f636c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:50:22.721255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b9bd-4c68-41a5-af14-fba96d8f2265 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:22.721781 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b9bd-4c68-41a5-af14-fba96d8f2265 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:22.721988 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b9bd-4c68-41a5-af14-fba96d8f2265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:22.744024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b000b9bd-4c68-41a5-af14-fba96d8f2265 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:22.745268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b000b9bd-4c68-41a5-af14-fba96d8f2265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:22.764195 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:22.805983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1304/2610] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:22.828105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:22.829624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:22.876315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:22.903781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946114c-b284-48a4-afa1-5a3c873bcff6 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:22.909342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:22.909941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:22.910218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:22.910486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:22.918587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:22.920144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:22.930026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1307/2611] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:26.855969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9da4-690a-47d1-8711-dcae1aaf431d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:26.856494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9da4-690a-47d1-8711-dcae1aaf431d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:26.856666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0b9da4-690a-47d1-8711-dcae1aaf431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:26.877883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3f0b9da4-690a-47d1-8711-dcae1aaf431d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:26.879611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3f0b9da4-690a-47d1-8711-dcae1aaf431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:26.887447 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1305/2612] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:26.921177 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:26.922631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:26.937645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c69f70-10a6-4ea8-8eb5-3d37cf846bc5 service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:26.943988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb722c-8d96-49d3-9325-6fe0a8bdff4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:26.944602 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb722c-8d96-49d3-9325-6fe0a8bdff4b service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:26.944881 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb722c-8d96-49d3-9325-6fe0a8bdff4b service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:26.945149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb722c-8d96-49d3-9325-6fe0a8bdff4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:26.953322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb722c-8d96-49d3-9325-6fe0a8bdff4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:26.954876 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb722c-8d96-49d3-9325-6fe0a8bdff4b service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:26.964593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1308/2613] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:31.051989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72267650-4a95-4e7b-96b9-ae68d5312e8d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:31.052518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72267650-4a95-4e7b-96b9-ae68d5312e8d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:31.052611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72267650-4a95-4e7b-96b9-ae68d5312e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:31.072836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-72267650-4a95-4e7b-96b9-ae68d5312e8d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:31.074077 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-72267650-4a95-4e7b-96b9-ae68d5312e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:31.082820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1306/2614] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:31.107738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb722c-8d96-49d3-9325-6fe0a8bdff4b service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:31.119260 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb722c-8d96-49d3-9325-6fe0a8bdff4b service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:31.124738 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6fd08-8390-4044-9135-8e15d929711b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:31.125327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6fd08-8390-4044-9135-8e15d929711b service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:31.125605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6fd08-8390-4044-9135-8e15d929711b service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:31.125877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6fd08-8390-4044-9135-8e15d929711b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:31.134644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6fd08-8390-4044-9135-8e15d929711b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:31.136239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6fd08-8390-4044-9135-8e15d929711b service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:31.146568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1309/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:36.257948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927939-2afb-4bf8-aa33-c65b836ee898 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:36.258471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927939-2afb-4bf8-aa33-c65b836ee898 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:36.258471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c927939-2afb-4bf8-aa33-c65b836ee898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:36.277509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-2c927939-2afb-4bf8-aa33-c65b836ee898 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:50:36.278700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2c927939-2afb-4bf8-aa33-c65b836ee898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:36.287470 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1307/2616] 10.222.0.55 () {58 vars in 1016 bytes} [Wed Aug 31 09:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:50:36.314598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6fd08-8390-4044-9135-8e15d929711b service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:36.325802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6fd08-8390-4044-9135-8e15d929711b service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:36.331262 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae01d3-9be9-4c43-8efd-102d43b9ee1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:36.331843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae01d3-9be9-4c43-8efd-102d43b9ee1c service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:36.332143 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae01d3-9be9-4c43-8efd-102d43b9ee1c service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:36.332441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae01d3-9be9-4c43-8efd-102d43b9ee1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:36.340465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae01d3-9be9-4c43-8efd-102d43b9ee1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:36.342014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae01d3-9be9-4c43-8efd-102d43b9ee1c service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:36.354430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1310/2617] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:46.272760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=25 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:46.347992 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=32 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:50:49.247441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c927939-2afb-4bf8-aa33-c65b836ee898 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:49.248918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2c927939-2afb-4bf8-aa33-c65b836ee898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:49.325397 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c927939-2afb-4bf8-aa33-c65b836ee898 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:49.329003 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:49.329610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:49.330026 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:49.330444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:49.332973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:49.348028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:49.349513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:49.361448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1308/2618] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:52.229699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae01d3-9be9-4c43-8efd-102d43b9ee1c service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:50:52.239792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae01d3-9be9-4c43-8efd-102d43b9ee1c service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:50:52.243397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:50:52.243984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:50:52.244306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:50:52.244579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:50:52.246324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:50:52.259497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:50:52.260955 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:50:52.273600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1311/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:50:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:50:59.355874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=26 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:02.267917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:02.584874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:02.598231 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00774d-83ae-44e0-92b5-d45e196b8595 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:02.604660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:02.605268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:02.605554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:02.605832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:02.607686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:02.670478 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:02.672114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:02.682410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1309/2620] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:51:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:51:05.276335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:05.294875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51f086-a224-4090-8185-ae4a0021405a service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:05.299038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:05.299612 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:05.300156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:05.300560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:05.303185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:05.363747 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:05.365851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:05.375171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1312/2621] 10.222.0.18 () {60 vars in 1396 bytes} [Wed Aug 31 09:51:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:51:06.877270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:06.878854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:06.890796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4e6ab-2805-444d-8b7b-40aff9cc0883 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:06.894333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:06.894930 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:06.895396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:06.895777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:06.897548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:06.907871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:06.909357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:06.919543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1310/2622] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:51:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:51:11.235184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:11.236740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:11.251427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7daa0-962e-43a2-97b5-ea77230d1d11 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:11.256724 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:11.257427 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:11.257715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:11.257989 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] PATH_INFO: `/v3/users/17c8209074544082a26183b7d8e122f6` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:11.259106 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c8209074544082a26183b7d8e122f6)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:11.261065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:11.307841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c8209074544082a26183b7d8e122f6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.320540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c8209074544082a26183b7d8e122f6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.321214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c8209074544082a26183b7d8e122f6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.321855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c8209074544082a26183b7d8e122f6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.329140 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ef4fc933-93e4-45b8-af4f-ca4b0dec6e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c8209074544082a26183b7d8e122f6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.341923 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1313/2623] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:51:11 2022] DELETE /identity/v3/users/17c8209074544082a26183b7d8e122f6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:51:11.513779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:11.526197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624be6c6-aa15-400e-9bee-d47e679ba29e service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:11.583615 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:11.584346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:11.584629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:11.584902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] PATH_INFO: `/v3/projects/ac57a3a9881642b990e10504e84d9cd2` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:11.586055 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac57a3a9881642b990e10504e84d9cd2)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:11.587982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:11.634575 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac57a3a9881642b990e10504e84d9cd2', 'request_id': 'req-cce56147-57bf-4622-8557-cbd4be6d4321'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.641768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac57a3a9881642b990e10504e84d9cd2', 'request_id': 'req-cce56147-57bf-4622-8557-cbd4be6d4321'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.648197 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac57a3a9881642b990e10504e84d9cd2', 'request_id': 'req-cce56147-57bf-4622-8557-cbd4be6d4321'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.658217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] The token cache is being invalidate because project ac57a3a9881642b990e10504e84d9cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:51:11.658504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.659132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cce56147-57bf-4622-8557-cbd4be6d4321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:11.660639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1311/2624] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:51:11 2022] DELETE /identity/v3/projects/ac57a3a9881642b990e10504e84d9cd2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:51:11.666621 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808264-3374-404f-8b90-2c73d04820da None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:11.666914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808264-3374-404f-8b90-2c73d04820da None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:11.667188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21808264-3374-404f-8b90-2c73d04820da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:11.687399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-21808264-3374-404f-8b90-2c73d04820da None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:51:11.688629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-21808264-3374-404f-8b90-2c73d04820da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:11.748846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1314/2625] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:51:11.756775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f941fd-98d8-4b92-9d4d-20ab80f3c65a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:11.757070 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f941fd-98d8-4b92-9d4d-20ab80f3c65a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:11.757493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f941fd-98d8-4b92-9d4d-20ab80f3c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:11.778993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b0f941fd-98d8-4b92-9d4d-20ab80f3c65a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:51:11.780241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b0f941fd-98d8-4b92-9d4d-20ab80f3c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:11.789173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1312/2626] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:51:11.793595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21808264-3374-404f-8b90-2c73d04820da None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:11.803487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21808264-3374-404f-8b90-2c73d04820da None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:11.808107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:11.808781 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:11.809057 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:11.809331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:11.809983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:51:11.810287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:11.811875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:11.818719 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:11.825309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1315/2627] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:51:11.829669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f941fd-98d8-4b92-9d4d-20ab80f3c65a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:11.840308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f941fd-98d8-4b92-9d4d-20ab80f3c65a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:11.844956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc048f-2f05-4ede-9084-8590fed54cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:11.845546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc048f-2f05-4ede-9084-8590fed54cae admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:11.845824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc048f-2f05-4ede-9084-8590fed54cae admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:11.846095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc048f-2f05-4ede-9084-8590fed54cae admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:11.846753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc048f-2f05-4ede-9084-8590fed54cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:11.848745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc048f-2f05-4ede-9084-8590fed54cae admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:11.854523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:11.877345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1313/2628] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:51:11 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:51:11.881700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:11.891728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8929ab5b-dc84-44bf-ab55-33d45c9dfa9b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:11.956532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8b130-7317-4adb-adad-a70713e73f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:11.957150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8b130-7317-4adb-adad-a70713e73f41 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:11.957430 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8b130-7317-4adb-adad-a70713e73f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:11.957702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8b130-7317-4adb-adad-a70713e73f41 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:11.958887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8b130-7317-4adb-adad-a70713e73f41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:11.960829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8b130-7317-4adb-adad-a70713e73f41 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:11.983227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1316/2629] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:51:11 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:51:11.987146 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc048f-2f05-4ede-9084-8590fed54cae admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:11.997556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc048f-2f05-4ede-9084-8590fed54cae admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:12.002316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa016-301d-4366-8494-2de3692bedbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:12.002847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa016-301d-4366-8494-2de3692bedbe admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:12.003127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa016-301d-4366-8494-2de3692bedbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:12.003398 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aafa016-301d-4366-8494-2de3692bedbe admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:12.004044 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafa016-301d-4366-8494-2de3692bedbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:12.005742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aafa016-301d-4366-8494-2de3692bedbe admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:12.016164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1314/2630] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:51:12.020001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8b130-7317-4adb-adad-a70713e73f41 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:12.030395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8b130-7317-4adb-adad-a70713e73f41 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:12.034978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc87dc-debc-4687-af3c-ad6567fd04d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:12.035571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc87dc-debc-4687-af3c-ad6567fd04d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:12.035846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc87dc-debc-4687-af3c-ad6567fd04d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:12.036239 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc87dc-debc-4687-af3c-ad6567fd04d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:12.036938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc87dc-debc-4687-af3c-ad6567fd04d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:12.038530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc87dc-debc-4687-af3c-ad6567fd04d5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:12.049783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1317/2631] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:51:12.054544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa016-301d-4366-8494-2de3692bedbe admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:12.064421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aafa016-301d-4366-8494-2de3692bedbe admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:12.069830 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:12.070516 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:12.070900 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:12.071107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] PATH_INFO: `/v3/projects/520674d1c05c4635862e9d35305f7a6f/users/d18657a1710348a0b02fe2a6c4631479/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:12.086228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=520674d1c05c4635862e9d35305f7a6f, user_id=d18657a1710348a0b02fe2a6c4631479, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:12.088947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:12.101807 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1315/2632] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:51:12 2022] PUT /identity/v3/projects/520674d1c05c4635862e9d35305f7a6f/users/d18657a1710348a0b02fe2a6c4631479/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:51:12.118522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f9c9-d43c-4438-bc24-b6f64e5fde62 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:12.118805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f9c9-d43c-4438-bc24-b6f64e5fde62 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:12.119073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f9c9-d43c-4438-bc24-b6f64e5fde62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:12.148133 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6137f9c9-d43c-4438-bc24-b6f64e5fde62 None None] MFA Rules not processed for user `d18657a1710348a0b02fe2a6c4631479`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:51:12.149370 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6137f9c9-d43c-4438-bc24-b6f64e5fde62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:12.212860 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1318/2633] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:51:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:51:12.225247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:12.226993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:12.283847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022bbfb-e1de-4a08-958a-66e6550affa6 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:12.288218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f8293-40c6-4204-a4ad-c01114203585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:12.289074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8293-40c6-4204-a4ad-c01114203585 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:12.289386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8293-40c6-4204-a4ad-c01114203585 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:12.289659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f8293-40c6-4204-a4ad-c01114203585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:12.297928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8293-40c6-4204-a4ad-c01114203585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:12.299372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f8293-40c6-4204-a4ad-c01114203585 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:12.308786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1316/2634] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:51:12 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:51:17.289952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137f9c9-d43c-4438-bc24-b6f64e5fde62 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:17.352113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6137f9c9-d43c-4438-bc24-b6f64e5fde62 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:17.356635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:17.357259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:17.357538 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:17.357810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] PATH_INFO: `/v3/users/d18657a1710348a0b02fe2a6c4631479` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:17.358921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18657a1710348a0b02fe2a6c4631479)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:17.360915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:17.366226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:17.406190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18657a1710348a0b02fe2a6c4631479'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:17.419026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18657a1710348a0b02fe2a6c4631479'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:17.419690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18657a1710348a0b02fe2a6c4631479'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:17.420332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18657a1710348a0b02fe2a6c4631479'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:17.428212 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18657a1710348a0b02fe2a6c4631479'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:17.440146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1319/2635] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:51:17 2022] DELETE /identity/v3/users/d18657a1710348a0b02fe2a6c4631479 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:51:17.445617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93fcf-e35f-4e03-a1c3-e2f28270a801 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:17.446104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93fcf-e35f-4e03-a1c3-e2f28270a801 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:17.446509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93fcf-e35f-4e03-a1c3-e2f28270a801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:17.465386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-dfe93fcf-e35f-4e03-a1c3-e2f28270a801 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:51:17.466572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dfe93fcf-e35f-4e03-a1c3-e2f28270a801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:17.526558 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1317/2636] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:51:17.536584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:17.538033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:17.594161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a0085-b310-4c05-ab1c-4f49fcee95b1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:17.597895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a56de2-f4ce-4872-aff4-20d939558b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:17.598996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56de2-f4ce-4872-aff4-20d939558b81 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:17.599279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56de2-f4ce-4872-aff4-20d939558b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:17.599550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56de2-f4ce-4872-aff4-20d939558b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:17.608648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a56de2-f4ce-4872-aff4-20d939558b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:17.610073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a56de2-f4ce-4872-aff4-20d939558b81 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:17.620107 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1320/2637] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:51:18.110835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe93fcf-e35f-4e03-a1c3-e2f28270a801 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:18.112362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dfe93fcf-e35f-4e03-a1c3-e2f28270a801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:18.127270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe93fcf-e35f-4e03-a1c3-e2f28270a801 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:18.132684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:18.133321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:18.133604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:18.133877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] PATH_INFO: `/v3/projects/520674d1c05c4635862e9d35305f7a6f` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:18.135814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520674d1c05c4635862e9d35305f7a6f)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:18.138128 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:18.184383 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520674d1c05c4635862e9d35305f7a6f', 'request_id': 'req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:18.186071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:18.192823 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520674d1c05c4635862e9d35305f7a6f', 'request_id': 'req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:18.200754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520674d1c05c4635862e9d35305f7a6f', 'request_id': 'req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:18.211382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] The token cache is being invalidate because project 520674d1c05c4635862e9d35305f7a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:51:18.211719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:18.212379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:51:18.213841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1318/2638] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:51:18 2022] DELETE /identity/v3/projects/520674d1c05c4635862e9d35305f7a6f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:51:24.983555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d614-9c92-4948-a41c-8da18ff6ff44 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:24.984112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d614-9c92-4948-a41c-8da18ff6ff44 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:24.984112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10d614-9c92-4948-a41c-8da18ff6ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:25.003349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-dd10d614-9c92-4948-a41c-8da18ff6ff44 None None] MFA Rules not processed for user `2f4f149b17ac48c4931338cc7b0b2112`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:51:25.004580 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dd10d614-9c92-4948-a41c-8da18ff6ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:25.065274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1321/2639] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:51:28.207724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=6 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:30.059071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:51:30.060698 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:30.143216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8420b4b-1bba-44b3-9f81-9d57f3f917d2 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:51:30.149660 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37fa57-a323-4e9e-b1aa-616c81d832be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:51:30.150292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37fa57-a323-4e9e-b1aa-616c81d832be service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:51:30.150576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37fa57-a323-4e9e-b1aa-616c81d832be service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:51:30.150849 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37fa57-a323-4e9e-b1aa-616c81d832be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:51:30.152685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-fb37fa57-a323-4e9e-b1aa-616c81d832be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:51:30.165987 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37fa57-a323-4e9e-b1aa-616c81d832be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:51:30.167531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37fa57-a323-4e9e-b1aa-616c81d832be service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:51:30.179035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1319/2640] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:51:35.058432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=74,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:51:40.174176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=34 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:00.362495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10d614-9c92-4948-a41c-8da18ff6ff44 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:00.364092 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-dd10d614-9c92-4948-a41c-8da18ff6ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:00.381308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd10d614-9c92-4948-a41c-8da18ff6ff44 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:00.387598 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:00.388338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:00.388658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:00.388961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:00.390713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:00.403744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:00.405385 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:00.417596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1322/2641] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:01.167066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466dac-6684-4055-81b4-bfee6c9043dd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:01.167639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466dac-6684-4055-81b4-bfee6c9043dd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:01.167767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a466dac-6684-4055-81b4-bfee6c9043dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:01.187210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4a466dac-6684-4055-81b4-bfee6c9043dd None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:01.188456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4a466dac-6684-4055-81b4-bfee6c9043dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:01.244907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1320/2642] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 31 09:52:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:01.293647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:01.295063 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:01.365636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c06a1-1e2b-4ca4-b501-e9b4d4d8b801 service nova] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:01.370711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236eb94-95a4-4dfc-9bbd-f209e8b9c756 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:01.371317 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236eb94-95a4-4dfc-9bbd-f209e8b9c756 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:01.371648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236eb94-95a4-4dfc-9bbd-f209e8b9c756 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:01.371919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236eb94-95a4-4dfc-9bbd-f209e8b9c756 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:01.379975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236eb94-95a4-4dfc-9bbd-f209e8b9c756 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:01.381576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236eb94-95a4-4dfc-9bbd-f209e8b9c756 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:01.389667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1323/2643] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:52:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:52:04.877037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7af44f-c813-49cf-b4dd-8e7fe506cbd1 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:04.877596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7af44f-c813-49cf-b4dd-8e7fe506cbd1 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:04.877984 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7af44f-c813-49cf-b4dd-8e7fe506cbd1 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:04.879716 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1321/2644] 10.222.0.18 () {54 vars in 961 bytes} [Wed Aug 31 09:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:52:04.885504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0eb88-7349-4c0d-a736-adf6792823cc None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:04.885925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0eb88-7349-4c0d-a736-adf6792823cc None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:04.886256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0eb88-7349-4c0d-a736-adf6792823cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:04.910000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0de0eb88-7349-4c0d-a736-adf6792823cc None None] MFA Rules not processed for user `55fa039431004ca19da7c95ad6f428a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:04.911441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0de0eb88-7349-4c0d-a736-adf6792823cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:04.948257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7af44f-c813-49cf-b4dd-8e7fe506cbd1 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:04.950502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cf7af44f-c813-49cf-b4dd-8e7fe506cbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:04.998736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1324/2645] 10.222.0.18 () {58 vars in 1058 bytes} [Wed Aug 31 09:52:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:05.012019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0eb88-7349-4c0d-a736-adf6792823cc None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:05.016792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7af44f-c813-49cf-b4dd-8e7fe506cbd1 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:05.020550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:05.021150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:05.021428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:05.021700 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:05.024345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:05.028407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0eb88-7349-4c0d-a736-adf6792823cc None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:05.033758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:05.034365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:05.034644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:05.034917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:05.036665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:05.049676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:05.051252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:05.062076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1325/2646] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:52:05.095566 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:05.097057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:05.106639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1322/2647] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:52:08.297696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:08.299201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:08.313647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a76e87-b7d8-418c-84fd-100b4e14bfba service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:08.318281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:08.318911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:08.319191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:08.319471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] PATH_INFO: `/v3/users/2cb4563a03f6449eb5c65bd000d341d4` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:08.320877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb4563a03f6449eb5c65bd000d341d4)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:08.322878 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:08.369929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb4563a03f6449eb5c65bd000d341d4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.375128 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:08.383500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb4563a03f6449eb5c65bd000d341d4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.384091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb4563a03f6449eb5c65bd000d341d4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.384723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb4563a03f6449eb5c65bd000d341d4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.392163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb4563a03f6449eb5c65bd000d341d4'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.404671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1326/2648] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:52:08 2022] DELETE /identity/v3/users/2cb4563a03f6449eb5c65bd000d341d4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:52:08.575686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:08.586673 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f46eee-c907-4a7c-8850-b5495a64d451 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:08.638724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=100 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:08.645641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:08.646297 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:08.646571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:08.646838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] PATH_INFO: `/v3/projects/72fedd2e2f8e4e0992d1b7e9ecd85c22` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:08.647944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72fedd2e2f8e4e0992d1b7e9ecd85c22)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:08.650073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:08.696130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72fedd2e2f8e4e0992d1b7e9ecd85c22', 'request_id': 'req-7a54e698-9348-4a32-8bcb-eb931174b7c2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.703831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72fedd2e2f8e4e0992d1b7e9ecd85c22', 'request_id': 'req-7a54e698-9348-4a32-8bcb-eb931174b7c2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.710314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72fedd2e2f8e4e0992d1b7e9ecd85c22', 'request_id': 'req-7a54e698-9348-4a32-8bcb-eb931174b7c2'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.720600 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] The token cache is being invalidate because project 72fedd2e2f8e4e0992d1b7e9ecd85c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:52:08.720916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.721599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.723092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1323/2649] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:52:08 2022] DELETE /identity/v3/projects/72fedd2e2f8e4e0992d1b7e9ecd85c22 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:52:08.727267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:08.729845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:08.743714 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa73a5-64cc-4b49-bfc9-e17dd3873ef1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:08.800255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:08.800898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:08.801162 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:08.801439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] PATH_INFO: `/v3/users/7153b53ad59f4636a57c976e8b901947` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:08.802582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7153b53ad59f4636a57c976e8b901947)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:08.804566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:08.850055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7153b53ad59f4636a57c976e8b901947'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.862520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7153b53ad59f4636a57c976e8b901947'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.863189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7153b53ad59f4636a57c976e8b901947'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.863873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7153b53ad59f4636a57c976e8b901947'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.870993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-f486efdb-4822-4786-9a9b-7cccd97972d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7153b53ad59f4636a57c976e8b901947'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:08.883756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1327/2650] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:52:08 2022] DELETE /identity/v3/users/7153b53ad59f4636a57c976e8b901947 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:52:09.055218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:09.056768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:09.075357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54e698-9348-4a32-8bcb-eb931174b7c2 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:09.144287 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:09.144923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:09.145206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:09.145487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] PATH_INFO: `/v3/projects/239c6f8ff9f8438ab3ed2ed76ec7434e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:09.146616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239c6f8ff9f8438ab3ed2ed76ec7434e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:09.149154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:09.194481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239c6f8ff9f8438ab3ed2ed76ec7434e', 'request_id': 'req-68d9b2e0-08fc-4572-bb2e-997191c14c54'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:09.202798 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239c6f8ff9f8438ab3ed2ed76ec7434e', 'request_id': 'req-68d9b2e0-08fc-4572-bb2e-997191c14c54'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:09.209007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239c6f8ff9f8438ab3ed2ed76ec7434e', 'request_id': 'req-68d9b2e0-08fc-4572-bb2e-997191c14c54'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:09.220057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] The token cache is being invalidate because project 239c6f8ff9f8438ab3ed2ed76ec7434e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:52:09.220379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:09.221021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:09.222503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1324/2651] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:52:09 2022] DELETE /identity/v3/projects/239c6f8ff9f8438ab3ed2ed76ec7434e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:52:18.880400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=63,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:19.217073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=77,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:19.417025 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa396928-ca3d-4d53-8b1a-39a6c654c176 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:19.417312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa396928-ca3d-4d53-8b1a-39a6c654c176 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:19.417590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa396928-ca3d-4d53-8b1a-39a6c654c176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:19.436785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-aa396928-ca3d-4d53-8b1a-39a6c654c176 None None] MFA Rules not processed for user `d5f210085ee04473b2808f0a2dfc37ac`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:19.437985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-aa396928-ca3d-4d53-8b1a-39a6c654c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:19.493726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1328/2652] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:52:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:19.883896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:19.885368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:19.947534 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9b2e0-08fc-4572-bb2e-997191c14c54 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:19.951336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:19.952058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:19.952241 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:19.952519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:19.954278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:19.964746 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:19.966186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:19.974650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1325/2653] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:21.342267 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa396928-ca3d-4d53-8b1a-39a6c654c176 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:21.343752 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-aa396928-ca3d-4d53-8b1a-39a6c654c176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:21.413132 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa396928-ca3d-4d53-8b1a-39a6c654c176 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:21.418785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:21.419392 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:21.419670 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:21.419943 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:21.421669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:21.434155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:21.435728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:21.446825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1329/2654] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:29.970935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=26 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:31.441526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=57 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:32.938268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:32.940244 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:33.034046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb67a9-2c8c-4219-83fe-7a4ca0851fe0 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:33.041174 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9021ea8b-5bfc-4f75-b959-f89e88ee4007 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:33.041769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ea8b-5bfc-4f75-b959-f89e88ee4007 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:33.042054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ea8b-5bfc-4f75-b959-f89e88ee4007 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:33.042328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9021ea8b-5bfc-4f75-b959-f89e88ee4007 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:33.044937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9021ea8b-5bfc-4f75-b959-f89e88ee4007 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:33.060747 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021ea8b-5bfc-4f75-b959-f89e88ee4007 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:33.062473 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9021ea8b-5bfc-4f75-b959-f89e88ee4007 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:33.074828 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1326/2655] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:36.628797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:36.630365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:36.712198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2638ba-cd1e-4966-93ac-edd697608ecd service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:36.717898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3d436-6204-4f96-8856-3eb59a7f5afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:36.718508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d436-6204-4f96-8856-3eb59a7f5afe service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:36.718790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d436-6204-4f96-8856-3eb59a7f5afe service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:36.719335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3d436-6204-4f96-8856-3eb59a7f5afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:36.721240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cdd3d436-6204-4f96-8856-3eb59a7f5afe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:36.797985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3d436-6204-4f96-8856-3eb59a7f5afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:36.799475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3d436-6204-4f96-8856-3eb59a7f5afe service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:36.811895 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1330/2656] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:38.131147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e37a-5e61-42e6-a42a-4c0bd09ec7e6 None None] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:38.131626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e37a-5e61-42e6-a42a-4c0bd09ec7e6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:38.131748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4e37a-5e61-42e6-a42a-4c0bd09ec7e6 None None] PATH_INFO: `/` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:38.133693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1327/2657] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:52:38.142302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e49e4-cfc2-4323-b59c-bc15c3fd756c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:38.143013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e49e4-cfc2-4323-b59c-bc15c3fd756c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:38.143211 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e49e4-cfc2-4323-b59c-bc15c3fd756c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:38.167288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b85e49e4-cfc2-4323-b59c-bc15c3fd756c None None] MFA Rules not processed for user `886e718c9d7d48aa8655b8993e2af945`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:38.168550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b85e49e4-cfc2-4323-b59c-bc15c3fd756c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:38.175498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1331/2658] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:38.192625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4e37a-5e61-42e6-a42a-4c0bd09ec7e6 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:38.194351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-51b4e37a-5e61-42e6-a42a-4c0bd09ec7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:38.209151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4e37a-5e61-42e6-a42a-4c0bd09ec7e6 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:38.213193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e51281-06a1-494a-b25c-1225c6b676de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:38.213820 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51281-06a1-494a-b25c-1225c6b676de service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:38.214102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51281-06a1-494a-b25c-1225c6b676de service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:38.214589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e51281-06a1-494a-b25c-1225c6b676de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:38.223859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51281-06a1-494a-b25c-1225c6b676de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:38.225709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e51281-06a1-494a-b25c-1225c6b676de service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:38.235659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1328/2659] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:38.341912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3c8f6-5f41-4fe2-9f7c-a33c3de079d8 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:38.342204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3c8f6-5f41-4fe2-9f7c-a33c3de079d8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:38.342686 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a3c8f6-5f41-4fe2-9f7c-a33c3de079d8 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:38.344283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1332/2660] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:52:38.350292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7858b3-2991-4030-8fc5-4e54bf8597f9 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:38.350577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7858b3-2991-4030-8fc5-4e54bf8597f9 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:38.350850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7858b3-2991-4030-8fc5-4e54bf8597f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:38.377024 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-da7858b3-2991-4030-8fc5-4e54bf8597f9 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:38.378736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-da7858b3-2991-4030-8fc5-4e54bf8597f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:38.391991 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1329/2661] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:52:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:38.403655 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3c8f6-5f41-4fe2-9f7c-a33c3de079d8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:38.416979 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a3c8f6-5f41-4fe2-9f7c-a33c3de079d8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:38.421590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:38.422206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:38.422491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:38.422766 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:38.436165 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:38.437656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:38.451888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1333/2662] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:48.370484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=43 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:48.444343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=57 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:51.226592 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7858b3-2991-4030-8fc5-4e54bf8597f9 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:51.236903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7858b3-2991-4030-8fc5-4e54bf8597f9 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:51.240457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:51.241054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:51.241405 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:51.241659 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:51.244001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:51.306176 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:51.307569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:51.317284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1330/2663] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:54.423206 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:54.424682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:54.438765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f3792-a571-479f-b22b-d2d3bbf4f7fa service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:54.443502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:54.444227 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:54.444509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:54.444779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] PATH_INFO: `/v3/users/2f4f149b17ac48c4931338cc7b0b2112` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:54.446042 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4f149b17ac48c4931338cc7b0b2112)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:54.448052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:54.493988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4f149b17ac48c4931338cc7b0b2112'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.506045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4f149b17ac48c4931338cc7b0b2112'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.506726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4f149b17ac48c4931338cc7b0b2112'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.507340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4f149b17ac48c4931338cc7b0b2112'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.515830 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3380b503-5cf3-42f1-b3aa-ba75d9ada931 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4f149b17ac48c4931338cc7b0b2112'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.528671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1334/2664] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:52:54 2022] DELETE /identity/v3/users/2f4f149b17ac48c4931338cc7b0b2112 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:52:54.703141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:54.713625 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ff542-4860-483b-a628-80a0210522f9 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:54.774078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:54.774981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:54.775267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:54.775550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] PATH_INFO: `/v3/projects/f067200a44ca4db39c4e081e755711f3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:54.776711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f067200a44ca4db39c4e081e755711f3)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:54.778702 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:54.824752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f067200a44ca4db39c4e081e755711f3', 'request_id': 'req-1ee54d58-1a67-48e9-84f0-caf33f1640c3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.831887 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f067200a44ca4db39c4e081e755711f3', 'request_id': 'req-1ee54d58-1a67-48e9-84f0-caf33f1640c3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.838204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f067200a44ca4db39c4e081e755711f3', 'request_id': 'req-1ee54d58-1a67-48e9-84f0-caf33f1640c3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.848206 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] The token cache is being invalidate because project f067200a44ca4db39c4e081e755711f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:52:54.848494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.849131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-1ee54d58-1a67-48e9-84f0-caf33f1640c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:52:54.850656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1331/2665] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:52:54 2022] DELETE /identity/v3/projects/f067200a44ca4db39c4e081e755711f3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:52:54.857326 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848668e-4c18-49e7-9175-413ba78770d6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:54.857690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848668e-4c18-49e7-9175-413ba78770d6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:54.858036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848668e-4c18-49e7-9175-413ba78770d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:54.878197 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4848668e-4c18-49e7-9175-413ba78770d6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:54.879395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4848668e-4c18-49e7-9175-413ba78770d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:54.940818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1335/2666] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:54.948496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcad93-5e47-41a5-92e1-100af7824894 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:54.948794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcad93-5e47-41a5-92e1-100af7824894 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:54.949072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcad93-5e47-41a5-92e1-100af7824894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:54.968680 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a2dcad93-5e47-41a5-92e1-100af7824894 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:54.969888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a2dcad93-5e47-41a5-92e1-100af7824894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:54.978719 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1332/2667] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:54.983121 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848668e-4c18-49e7-9175-413ba78770d6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:54.993526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848668e-4c18-49e7-9175-413ba78770d6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:54.998098 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:54.998696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:54.998984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:54.999246 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:54.999926 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:52:55.000249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:55.001840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:55.013295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1336/2668] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:52:55.017504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcad93-5e47-41a5-92e1-100af7824894 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:55.027084 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcad93-5e47-41a5-92e1-100af7824894 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:55.031759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d17ef8-f3d4-47b3-9bfc-f76cf150f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:55.032385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d17ef8-f3d4-47b3-9bfc-f76cf150f2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:55.032669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d17ef8-f3d4-47b3-9bfc-f76cf150f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:55.032939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d17ef8-f3d4-47b3-9bfc-f76cf150f2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:55.033576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d17ef8-f3d4-47b3-9bfc-f76cf150f2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:55.035513 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d17ef8-f3d4-47b3-9bfc-f76cf150f2e7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:55.051797 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:55.066222 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1333/2669] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:52:55 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:52:55.070428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:55.080614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33aafff-84ec-4f40-99a8-30728bf36d2a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:55.137229 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65527268-28fd-4301-9d7f-2b73834ac184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:55.137832 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65527268-28fd-4301-9d7f-2b73834ac184 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:55.138113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65527268-28fd-4301-9d7f-2b73834ac184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:55.138388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65527268-28fd-4301-9d7f-2b73834ac184 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:55.139036 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65527268-28fd-4301-9d7f-2b73834ac184 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:55.140987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65527268-28fd-4301-9d7f-2b73834ac184 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:55.148898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:52:55.163316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1337/2670] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:52:55 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:52:55.167846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d17ef8-f3d4-47b3-9bfc-f76cf150f2e7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:55.178131 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d17ef8-f3d4-47b3-9bfc-f76cf150f2e7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:55.183238 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642093-4c98-44c2-8414-3d3e0e099298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:55.183827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642093-4c98-44c2-8414-3d3e0e099298 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:55.184109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642093-4c98-44c2-8414-3d3e0e099298 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:55.184411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d642093-4c98-44c2-8414-3d3e0e099298 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:55.185073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642093-4c98-44c2-8414-3d3e0e099298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:55.186715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d642093-4c98-44c2-8414-3d3e0e099298 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:55.197345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1334/2671] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:52:55.201396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65527268-28fd-4301-9d7f-2b73834ac184 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:55.211369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65527268-28fd-4301-9d7f-2b73834ac184 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:55.216135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37325ac0-67b6-4696-9806-4bc2c30bf885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:55.216756 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37325ac0-67b6-4696-9806-4bc2c30bf885 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:55.217038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37325ac0-67b6-4696-9806-4bc2c30bf885 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:55.217309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37325ac0-67b6-4696-9806-4bc2c30bf885 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:55.217972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37325ac0-67b6-4696-9806-4bc2c30bf885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:55.219566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37325ac0-67b6-4696-9806-4bc2c30bf885 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:55.230109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1338/2672] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:52:55.234087 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642093-4c98-44c2-8414-3d3e0e099298 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:55.244997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d642093-4c98-44c2-8414-3d3e0e099298 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:55.249675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:55.250340 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:55.250637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:55.250897 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] PATH_INFO: `/v3/projects/b23db7377f9c47de9bf28f01aefc7c5e/users/5a481c138d994aee9db3ae7a161a735b/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:55.265748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23db7377f9c47de9bf28f01aefc7c5e, user_id=5a481c138d994aee9db3ae7a161a735b, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:55.268436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:55.281378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1335/2673] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:52:55 2022] PUT /identity/v3/projects/b23db7377f9c47de9bf28f01aefc7c5e/users/5a481c138d994aee9db3ae7a161a735b/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:52:55.286466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4b8c-2af5-48ce-b444-9efe1ac60c95 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:55.286806 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4b8c-2af5-48ce-b444-9efe1ac60c95 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:55.287083 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4b8c-2af5-48ce-b444-9efe1ac60c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:55.306557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-c37b4b8c-2af5-48ce-b444-9efe1ac60c95 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:55.307747 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c37b4b8c-2af5-48ce-b444-9efe1ac60c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:55.365913 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1339/2674] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:55.375616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:55.377360 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:55.436272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf896d2-5ed7-46ad-bba9-6eec3f24ead7 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:55.439873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:55.440508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:55.440785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:55.441058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:55.450727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:55.452158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:55.461394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1336/2675] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:52:59.385929 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2692b-49eb-49ce-8423-9a388609aa10 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:59.386458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2692b-49eb-49ce-8423-9a388609aa10 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:59.386560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2692b-49eb-49ce-8423-9a388609aa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:59.420355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-1ac2692b-49eb-49ce-8423-9a388609aa10 None None] MFA Rules not processed for user `5a481c138d994aee9db3ae7a161a735b`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:52:59.421920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1ac2692b-49eb-49ce-8423-9a388609aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:59.489853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1340/2676] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:52:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:52:59.505157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:52:59.506748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:52:59.581599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdfa50-992b-4091-af32-5110256ade82 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:52:59.587710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f861d-6f89-44b7-8eb3-ef2ac826cb9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:52:59.588356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f861d-6f89-44b7-8eb3-ef2ac826cb9b service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:52:59.588640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f861d-6f89-44b7-8eb3-ef2ac826cb9b service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:52:59.588910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465f861d-6f89-44b7-8eb3-ef2ac826cb9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:52:59.596723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f861d-6f89-44b7-8eb3-ef2ac826cb9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:52:59.598326 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465f861d-6f89-44b7-8eb3-ef2ac826cb9b service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:52:59.612655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1337/2677] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:52:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:53:00.993551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3271-362c-40f0-b2b8-c2adcc675122 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:53:00.994195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3271-362c-40f0-b2b8-c2adcc675122 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:53:00.994195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab3271-362c-40f0-b2b8-c2adcc675122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:53:01.012984 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-09ab3271-362c-40f0-b2b8-c2adcc675122 None None] MFA Rules not processed for user `5a481c138d994aee9db3ae7a161a735b`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:53:01.014161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-09ab3271-362c-40f0-b2b8-c2adcc675122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:53:01.021028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1341/2678] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:53:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:53:01.326824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f861d-6f89-44b7-8eb3-ef2ac826cb9b service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:53:01.336145 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465f861d-6f89-44b7-8eb3-ef2ac826cb9b service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:53:01.340624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:53:01.341219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:53:01.341503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:53:01.341776 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:53:01.343524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:53:01.354815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:53:01.356304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:53:01.365158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1338/2679] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:53:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:53:11.007565 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:53:11.361149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=83,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:09.152712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab3271-362c-40f0-b2b8-c2adcc675122 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:09.154615 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-09ab3271-362c-40f0-b2b8-c2adcc675122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:09.322051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ab3271-362c-40f0-b2b8-c2adcc675122 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:09.327941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:09.328677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:09.329023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:09.329363 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:09.331291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:09.343503 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:09.345249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:09.355469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1342/2680] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:14.535644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:14.571585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4848a-99be-48a0-96af-a87470c08b87 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:14.575175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:14.575763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:14.576039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:14.576347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:14.578067 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:14.613942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:14.615369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:14.634511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1339/2681] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:17.845415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:17.847616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:17.880159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67856fe8-41b3-4d36-9548-9193d2f2b039 service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:17.884903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:17.885525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:17.885804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:17.887868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] PATH_INFO: `/v3/users/d5f210085ee04473b2808f0a2dfc37ac` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:17.889001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5f210085ee04473b2808f0a2dfc37ac)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:17.892087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:17.951523 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5f210085ee04473b2808f0a2dfc37ac'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:17.972600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5f210085ee04473b2808f0a2dfc37ac'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:17.973981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5f210085ee04473b2808f0a2dfc37ac'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:17.976334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5f210085ee04473b2808f0a2dfc37ac'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:17.984104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-8d60b579-4540-4b72-92e0-a4832f031976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5f210085ee04473b2808f0a2dfc37ac'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:17.989321 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:17.999599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1343/2682] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:17 2022] DELETE /identity/v3/users/d5f210085ee04473b2808f0a2dfc37ac => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:18.171654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:18.184112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b7273-2657-4f9b-b9ef-d177e21eca7e service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:18.241577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:18.242136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.242420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.242714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] PATH_INFO: `/v3/projects/48cc1f402f3b4d58ad2c3e8de14095f7` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.243853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cc1f402f3b4d58ad2c3e8de14095f7)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:18.245822 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:18.291502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cc1f402f3b4d58ad2c3e8de14095f7', 'request_id': 'req-81f4c479-9319-44b9-a8e1-5b95464eb6d1'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:18.298782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cc1f402f3b4d58ad2c3e8de14095f7', 'request_id': 'req-81f4c479-9319-44b9-a8e1-5b95464eb6d1'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:18.305842 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cc1f402f3b4d58ad2c3e8de14095f7', 'request_id': 'req-81f4c479-9319-44b9-a8e1-5b95464eb6d1'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:18.315959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] The token cache is being invalidate because project 48cc1f402f3b4d58ad2c3e8de14095f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:18.316271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:18.316928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-81f4c479-9319-44b9-a8e1-5b95464eb6d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:18.318431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1340/2683] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:18 2022] DELETE /identity/v3/projects/48cc1f402f3b4d58ad2c3e8de14095f7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:18.323543 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503bf9-8c36-4572-b080-f7c38930cbac None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.323834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503bf9-8c36-4572-b080-f7c38930cbac None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.324109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e503bf9-8c36-4572-b080-f7c38930cbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.382148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-3e503bf9-8c36-4572-b080-f7c38930cbac None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:18.383349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-3e503bf9-8c36-4572-b080-f7c38930cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:18.441324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1344/2684] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:18.449419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524d36-223f-4c1f-bc53-8fc0f1390a6a None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.449699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524d36-223f-4c1f-bc53-8fc0f1390a6a None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.449968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524d36-223f-4c1f-bc53-8fc0f1390a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.469253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-25524d36-223f-4c1f-bc53-8fc0f1390a6a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:18.470474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-25524d36-223f-4c1f-bc53-8fc0f1390a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:18.478894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1341/2685] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:18.483247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e503bf9-8c36-4572-b080-f7c38930cbac None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:18.493855 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e503bf9-8c36-4572-b080-f7c38930cbac None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:18.498535 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:18.499159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.499444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.499721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.500413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:54:18.500723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:18.502318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:18.514056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1345/2686] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:54:18.518186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524d36-223f-4c1f-bc53-8fc0f1390a6a None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:18.528193 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524d36-223f-4c1f-bc53-8fc0f1390a6a None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:18.532902 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ad497-71b6-421e-9015-799eff9cf949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:18.533485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ad497-71b6-421e-9015-799eff9cf949 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.533760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ad497-71b6-421e-9015-799eff9cf949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.534054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669ad497-71b6-421e-9015-799eff9cf949 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.535435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ad497-71b6-421e-9015-799eff9cf949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:18.537370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669ad497-71b6-421e-9015-799eff9cf949 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:18.552048 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:18.566040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1342/2687] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:18 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:18.570499 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:18.580384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05017b-05fd-4199-bda5-2196ff5f0614 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:18.635582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756800-c313-4ffc-9157-0d26d2013eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:18.636199 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756800-c313-4ffc-9157-0d26d2013eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.636476 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756800-c313-4ffc-9157-0d26d2013eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.636746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3756800-c313-4ffc-9157-0d26d2013eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.637379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756800-c313-4ffc-9157-0d26d2013eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:18.639287 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3756800-c313-4ffc-9157-0d26d2013eb7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:18.665331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1346/2688] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:18 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:54:18.666647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ad497-71b6-421e-9015-799eff9cf949 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:18.677181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669ad497-71b6-421e-9015-799eff9cf949 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:18.681794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4586d-27ba-4d8f-ad6d-898e03cef49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:18.682389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4586d-27ba-4d8f-ad6d-898e03cef49c admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.682670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4586d-27ba-4d8f-ad6d-898e03cef49c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.682943 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4586d-27ba-4d8f-ad6d-898e03cef49c admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.683578 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4586d-27ba-4d8f-ad6d-898e03cef49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:18.685220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4586d-27ba-4d8f-ad6d-898e03cef49c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:18.695050 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1343/2689] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:18.699088 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756800-c313-4ffc-9157-0d26d2013eb7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:18.709797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3756800-c313-4ffc-9157-0d26d2013eb7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:18.714453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0426c4f-891e-43f0-8a75-08b9472de7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:18.715048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0426c4f-891e-43f0-8a75-08b9472de7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.715329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0426c4f-891e-43f0-8a75-08b9472de7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.715610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0426c4f-891e-43f0-8a75-08b9472de7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.716276 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0426c4f-891e-43f0-8a75-08b9472de7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:18.717866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0426c4f-891e-43f0-8a75-08b9472de7b9 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:18.729455 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1347/2690] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:18.733661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4586d-27ba-4d8f-ad6d-898e03cef49c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:18.743581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4586d-27ba-4d8f-ad6d-898e03cef49c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:18.748163 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:18.748831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.749112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.749390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] PATH_INFO: `/v3/projects/a288695a25ab45048d741234e6362692/users/e932c5377e494ee1a7b2dc466ded74ef/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.763704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a288695a25ab45048d741234e6362692, user_id=e932c5377e494ee1a7b2dc466ded74ef, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:18.766431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:18.780757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1344/2691] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:18 2022] PUT /identity/v3/projects/a288695a25ab45048d741234e6362692/users/e932c5377e494ee1a7b2dc466ded74ef/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:18.792000 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfcb4a-ad8d-4bb3-aec7-f3057e7f1e70 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:18.792322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfcb4a-ad8d-4bb3-aec7-f3057e7f1e70 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:18.792600 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfcb4a-ad8d-4bb3-aec7-f3057e7f1e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:18.822759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-99dfcb4a-ad8d-4bb3-aec7-f3057e7f1e70 None None] MFA Rules not processed for user `e932c5377e494ee1a7b2dc466ded74ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:18.823875 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-99dfcb4a-ad8d-4bb3-aec7-f3057e7f1e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:18.840453 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:19.015178 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1348/2692] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:19.028429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:19.030148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:19.129989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414e9e7-3e6c-4d5b-a2ab-9e7aef17adb5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:19.135529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f61f57-b45a-424c-9f5c-3ac83396b132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:19.136129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61f57-b45a-424c-9f5c-3ac83396b132 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:19.136445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61f57-b45a-424c-9f5c-3ac83396b132 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:19.136721 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f61f57-b45a-424c-9f5c-3ac83396b132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:19.144788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f61f57-b45a-424c-9f5c-3ac83396b132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:19.146416 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f61f57-b45a-424c-9f5c-3ac83396b132 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:19.155058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1345/2693] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:24.393124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfcb4a-ad8d-4bb3-aec7-f3057e7f1e70 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:24.457198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfcb4a-ad8d-4bb3-aec7-f3057e7f1e70 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:24.461809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:24.462482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:24.462759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:24.463026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] PATH_INFO: `/v3/users/e932c5377e494ee1a7b2dc466ded74ef` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:24.464127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e932c5377e494ee1a7b2dc466ded74ef)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:24.466037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:24.512891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e932c5377e494ee1a7b2dc466ded74ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:24.525291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e932c5377e494ee1a7b2dc466ded74ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:24.525898 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e932c5377e494ee1a7b2dc466ded74ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:24.526506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e932c5377e494ee1a7b2dc466ded74ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:24.533779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e932c5377e494ee1a7b2dc466ded74ef'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:24.546871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1349/2694] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:24 2022] DELETE /identity/v3/users/e932c5377e494ee1a7b2dc466ded74ef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:54:24.551435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2539aa-de15-46ee-aa01-8b0ed98fbcff None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:24.551901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2539aa-de15-46ee-aa01-8b0ed98fbcff None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:24.551998 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2539aa-de15-46ee-aa01-8b0ed98fbcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:24.570818 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-5a2539aa-de15-46ee-aa01-8b0ed98fbcff None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:24.572016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5a2539aa-de15-46ee-aa01-8b0ed98fbcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:24.630504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1346/2695] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:24.640073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:24.641529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:24.685210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:24.712835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a001c6-3aa8-4ca6-9d27-f8a1bbd56bdc admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:24.716423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc526-8a04-4748-8e82-3ce190830cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:24.717047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc526-8a04-4748-8e82-3ce190830cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:24.717324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc526-8a04-4748-8e82-3ce190830cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:24.717593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc526-8a04-4748-8e82-3ce190830cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:24.728371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc526-8a04-4748-8e82-3ce190830cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:24.729815 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc526-8a04-4748-8e82-3ce190830cb5 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:24.739032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1350/2696] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:25.010037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2539aa-de15-46ee-aa01-8b0ed98fbcff None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.011469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5a2539aa-de15-46ee-aa01-8b0ed98fbcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:25.024148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2539aa-de15-46ee-aa01-8b0ed98fbcff None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.028744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.029366 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.029709 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.029918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] PATH_INFO: `/v3/projects/a288695a25ab45048d741234e6362692` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.031036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a288695a25ab45048d741234e6362692)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.033009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.045846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:25.081792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a288695a25ab45048d741234e6362692', 'request_id': 'req-b0871a06-57db-4f66-836b-98bfd07bc0ed'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:25.089004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a288695a25ab45048d741234e6362692', 'request_id': 'req-b0871a06-57db-4f66-836b-98bfd07bc0ed'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:25.095185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a288695a25ab45048d741234e6362692', 'request_id': 'req-b0871a06-57db-4f66-836b-98bfd07bc0ed'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:25.106104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] The token cache is being invalidate because project a288695a25ab45048d741234e6362692 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:25.106391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:25.107049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b0871a06-57db-4f66-836b-98bfd07bc0ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:25.108583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1347/2697] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:25 2022] DELETE /identity/v3/projects/a288695a25ab45048d741234e6362692 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:25.114093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100ffce-7a89-43c9-9dd2-a49c53279d9f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.114389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100ffce-7a89-43c9-9dd2-a49c53279d9f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.114664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100ffce-7a89-43c9-9dd2-a49c53279d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.133648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-9100ffce-7a89-43c9-9dd2-a49c53279d9f None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:25.134852 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9100ffce-7a89-43c9-9dd2-a49c53279d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:25.196135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1351/2698] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:25.204043 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a1cf-c98d-41b6-86e6-8fe6643274d5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.204371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a1cf-c98d-41b6-86e6-8fe6643274d5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.204643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4a1cf-c98d-41b6-86e6-8fe6643274d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.224445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-23d4a1cf-c98d-41b6-86e6-8fe6643274d5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:25.225636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-23d4a1cf-c98d-41b6-86e6-8fe6643274d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:25.233321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1348/2699] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:25.237938 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100ffce-7a89-43c9-9dd2-a49c53279d9f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.247541 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100ffce-7a89-43c9-9dd2-a49c53279d9f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.252089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.252720 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.253112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.253389 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.254039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:54:25.254343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.255921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.267221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1352/2700] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:54:25.272097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a1cf-c98d-41b6-86e6-8fe6643274d5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.281346 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4a1cf-c98d-41b6-86e6-8fe6643274d5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.286772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d7448-12a7-411d-86bd-99bb6557c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.287362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7448-12a7-411d-86bd-99bb6557c2ef admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.287647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7448-12a7-411d-86bd-99bb6557c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.288047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d7448-12a7-411d-86bd-99bb6557c2ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.288727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d7448-12a7-411d-86bd-99bb6557c2ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.290904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d7448-12a7-411d-86bd-99bb6557c2ef admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.318350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1349/2701] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:25 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:25.322542 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.333510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14549d7e-95e9-44e7-b792-76cb06477e86 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.389288 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921563eb-3e8a-4d24-9a9b-48614c1b8d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.389885 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921563eb-3e8a-4d24-9a9b-48614c1b8d53 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.390163 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921563eb-3e8a-4d24-9a9b-48614c1b8d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.390431 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921563eb-3e8a-4d24-9a9b-48614c1b8d53 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.391062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921563eb-3e8a-4d24-9a9b-48614c1b8d53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.393038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921563eb-3e8a-4d24-9a9b-48614c1b8d53 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.414640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1353/2702] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:25 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:25.418812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d7448-12a7-411d-86bd-99bb6557c2ef admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.430013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d7448-12a7-411d-86bd-99bb6557c2ef admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.434656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13810adf-694b-4b88-aaed-88287a7383be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.435247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810adf-694b-4b88-aaed-88287a7383be admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.435530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810adf-694b-4b88-aaed-88287a7383be admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.435802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13810adf-694b-4b88-aaed-88287a7383be admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.436476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13810adf-694b-4b88-aaed-88287a7383be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.438083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13810adf-694b-4b88-aaed-88287a7383be admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.448765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1350/2703] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:25.452569 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921563eb-3e8a-4d24-9a9b-48614c1b8d53 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.463073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921563eb-3e8a-4d24-9a9b-48614c1b8d53 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.467698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c2e54-ef42-4702-8241-850f1b431c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.468322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2e54-ef42-4702-8241-850f1b431c04 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.468603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2e54-ef42-4702-8241-850f1b431c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.468872 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c2e54-ef42-4702-8241-850f1b431c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.469509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c2e54-ef42-4702-8241-850f1b431c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.471124 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c2e54-ef42-4702-8241-850f1b431c04 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.481856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1354/2704] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:25.485982 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13810adf-694b-4b88-aaed-88287a7383be admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.495787 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13810adf-694b-4b88-aaed-88287a7383be admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.500391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797e12-25b3-4bd4-aa50-cc8d165c2548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.501025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797e12-25b3-4bd4-aa50-cc8d165c2548 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.501300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797e12-25b3-4bd4-aa50-cc8d165c2548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.501570 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd797e12-25b3-4bd4-aa50-cc8d165c2548 admin admin] PATH_INFO: `/v3/projects/e25a9e4783f54980987bdf010f4b5b8b/users/ee2dc58021ed4a67a041b95918100ad5/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.516509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797e12-25b3-4bd4-aa50-cc8d165c2548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25a9e4783f54980987bdf010f4b5b8b, user_id=ee2dc58021ed4a67a041b95918100ad5, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.519908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd797e12-25b3-4bd4-aa50-cc8d165c2548 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.532691 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1351/2705] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:25 2022] PUT /identity/v3/projects/e25a9e4783f54980987bdf010f4b5b8b/users/ee2dc58021ed4a67a041b95918100ad5/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:54:25.544001 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59093d-1dea-4a7d-887d-daa6a563ecc8 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.544323 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59093d-1dea-4a7d-887d-daa6a563ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.544594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59093d-1dea-4a7d-887d-daa6a563ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.572052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-be59093d-1dea-4a7d-887d-daa6a563ecc8 None None] MFA Rules not processed for user `ee2dc58021ed4a67a041b95918100ad5`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:25.573314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-be59093d-1dea-4a7d-887d-daa6a563ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:25.598708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:25.642056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1355/2706] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:25.647302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797e12-25b3-4bd4-aa50-cc8d165c2548 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.708996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd797e12-25b3-4bd4-aa50-cc8d165c2548 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.713622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3871b-70dc-4e62-8946-4ea3a1ce4b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.714217 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3871b-70dc-4e62-8946-4ea3a1ce4b6e admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.714497 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3871b-70dc-4e62-8946-4ea3a1ce4b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.714769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3871b-70dc-4e62-8946-4ea3a1ce4b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.715391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3871b-70dc-4e62-8946-4ea3a1ce4b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.717376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3871b-70dc-4e62-8946-4ea3a1ce4b6e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.743617 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1352/2707] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:25 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:25.747727 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59093d-1dea-4a7d-887d-daa6a563ecc8 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.758834 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59093d-1dea-4a7d-887d-daa6a563ecc8 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.815230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61008d9-c893-4d83-ba2a-11c1db083438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.816985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61008d9-c893-4d83-ba2a-11c1db083438 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.816985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61008d9-c893-4d83-ba2a-11c1db083438 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.816985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61008d9-c893-4d83-ba2a-11c1db083438 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.817302 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61008d9-c893-4d83-ba2a-11c1db083438 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.819146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61008d9-c893-4d83-ba2a-11c1db083438 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.839841 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1356/2708] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:25 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:54:25.843977 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3871b-70dc-4e62-8946-4ea3a1ce4b6e admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.854866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3871b-70dc-4e62-8946-4ea3a1ce4b6e admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.859376 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a66d2-77b4-43db-a2e1-86ff1f3a8090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.859969 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a66d2-77b4-43db-a2e1-86ff1f3a8090 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.860286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a66d2-77b4-43db-a2e1-86ff1f3a8090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.860560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a66d2-77b4-43db-a2e1-86ff1f3a8090 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.861200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a66d2-77b4-43db-a2e1-86ff1f3a8090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.863370 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a66d2-77b4-43db-a2e1-86ff1f3a8090 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.873641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1353/2709] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:25.877816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61008d9-c893-4d83-ba2a-11c1db083438 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.888146 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61008d9-c893-4d83-ba2a-11c1db083438 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.892772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfff1a-9599-4114-a647-d4bad7d14ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:25.893412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfff1a-9599-4114-a647-d4bad7d14ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:25.893823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfff1a-9599-4114-a647-d4bad7d14ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:25.894069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfff1a-9599-4114-a647-d4bad7d14ff7 admin admin] PATH_INFO: `/v3/projects/5dc051bb320e4a6e9e141cefc3a386c3/users/e0c90b4292414b31b3dca39dd6c5ea7f/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:25.908277 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfff1a-9599-4114-a647-d4bad7d14ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc051bb320e4a6e9e141cefc3a386c3, user_id=e0c90b4292414b31b3dca39dd6c5ea7f, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:25.911552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfff1a-9599-4114-a647-d4bad7d14ff7 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:25.925384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1357/2710] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:25 2022] PUT /identity/v3/projects/5dc051bb320e4a6e9e141cefc3a386c3/users/e0c90b4292414b31b3dca39dd6c5ea7f/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:25.929467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a66d2-77b4-43db-a2e1-86ff1f3a8090 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:25.939306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a66d2-77b4-43db-a2e1-86ff1f3a8090 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:25.947594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:26.001151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99faffd-f037-4c4a-9f48-0b543e4b51f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:26.001759 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faffd-f037-4c4a-9f48-0b543e4b51f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:26.002040 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faffd-f037-4c4a-9f48-0b543e4b51f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:26.002317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99faffd-f037-4c4a-9f48-0b543e4b51f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:26.003577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99faffd-f037-4c4a-9f48-0b543e4b51f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:26.005280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99faffd-f037-4c4a-9f48-0b543e4b51f0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:26.014848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1354/2711] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:26.019292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfff1a-9599-4114-a647-d4bad7d14ff7 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:26.029664 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfff1a-9599-4114-a647-d4bad7d14ff7 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:26.034379 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:26.035100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:26.035378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:26.035646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] PATH_INFO: `/v3/projects/5dc051bb320e4a6e9e141cefc3a386c3/users/e0c90b4292414b31b3dca39dd6c5ea7f/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:26.037597 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc051bb320e4a6e9e141cefc3a386c3, user_id=e0c90b4292414b31b3dca39dd6c5ea7f, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:26.040496 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:26.051498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1358/2712] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:26 2022] PUT /identity/v3/projects/5dc051bb320e4a6e9e141cefc3a386c3/users/e0c90b4292414b31b3dca39dd6c5ea7f/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:26.067671 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7268c9-2838-4696-827d-68c5bf966f37 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:26.067966 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7268c9-2838-4696-827d-68c5bf966f37 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:26.068248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7268c9-2838-4696-827d-68c5bf966f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:26.095623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8f7268c9-2838-4696-827d-68c5bf966f37 None None] MFA Rules not processed for user `e0c90b4292414b31b3dca39dd6c5ea7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:26.097542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8f7268c9-2838-4696-827d-68c5bf966f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:26.164763 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1355/2713] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:26.176672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:26.178388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:26.256333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d395091-ff76-4094-bdcc-e5b61f765746 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:26.259995 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fc9cf-92d2-4ed0-8f92-2c6ef113b20c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:26.260622 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fc9cf-92d2-4ed0-8f92-2c6ef113b20c service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:26.260902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fc9cf-92d2-4ed0-8f92-2c6ef113b20c service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:26.261177 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fc9cf-92d2-4ed0-8f92-2c6ef113b20c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:26.270329 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fc9cf-92d2-4ed0-8f92-2c6ef113b20c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:26.271733 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fc9cf-92d2-4ed0-8f92-2c6ef113b20c service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:26.276634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:26.281524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1359/2714] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:26.664939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7268c9-2838-4696-827d-68c5bf966f37 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:26.726808 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7268c9-2838-4696-827d-68c5bf966f37 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:26.730678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:26.731293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:26.731571 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:26.731843 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] PATH_INFO: `/v3/users/ee2dc58021ed4a67a041b95918100ad5` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:26.733009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2dc58021ed4a67a041b95918100ad5)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:26.734932 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:26.772783 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:26.782636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2dc58021ed4a67a041b95918100ad5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:26.783310 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2dc58021ed4a67a041b95918100ad5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:26.790380 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2dc58021ed4a67a041b95918100ad5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:26.802471 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2dc58021ed4a67a041b95918100ad5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:26.809443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2dc58021ed4a67a041b95918100ad5'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:26.815234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1356/2715] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:26 2022] DELETE /identity/v3/users/ee2dc58021ed4a67a041b95918100ad5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:26.820502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df809ff-1f04-4335-821a-6a0a2c5c45cf None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:26.820977 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df809ff-1f04-4335-821a-6a0a2c5c45cf None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:26.821076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df809ff-1f04-4335-821a-6a0a2c5c45cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:26.840039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7df809ff-1f04-4335-821a-6a0a2c5c45cf None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:26.841258 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7df809ff-1f04-4335-821a-6a0a2c5c45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:26.900352 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1360/2716] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:26.910666 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:26.912057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:26.968883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7681f78-a268-4d57-b5ae-dceae60dab69 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:26.973157 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749978a4-9642-4213-9a28-4cd56f1ba56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:26.973753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749978a4-9642-4213-9a28-4cd56f1ba56b service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:26.974035 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749978a4-9642-4213-9a28-4cd56f1ba56b service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:26.974329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749978a4-9642-4213-9a28-4cd56f1ba56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:26.983307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749978a4-9642-4213-9a28-4cd56f1ba56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:26.984715 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749978a4-9642-4213-9a28-4cd56f1ba56b service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:26.993975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1357/2717] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:54:27.263997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df809ff-1f04-4335-821a-6a0a2c5c45cf None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:27.265456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7df809ff-1f04-4335-821a-6a0a2c5c45cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:27.278257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df809ff-1f04-4335-821a-6a0a2c5c45cf None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:27.283161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:27.283796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:27.284078 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:27.284421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] PATH_INFO: `/v3/projects/e25a9e4783f54980987bdf010f4b5b8b` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:27.285566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25a9e4783f54980987bdf010f4b5b8b)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:27.287530 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:27.334805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25a9e4783f54980987bdf010f4b5b8b', 'request_id': 'req-ce55cb20-e105-45d1-a2f7-1755458940b6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.341202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25a9e4783f54980987bdf010f4b5b8b', 'request_id': 'req-ce55cb20-e105-45d1-a2f7-1755458940b6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.347631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25a9e4783f54980987bdf010f4b5b8b', 'request_id': 'req-ce55cb20-e105-45d1-a2f7-1755458940b6'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.357790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] The token cache is being invalidate because project e25a9e4783f54980987bdf010f4b5b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:27.358073 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.358706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.360195 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1361/2718] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:27 2022] DELETE /identity/v3/projects/e25a9e4783f54980987bdf010f4b5b8b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:27.364477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749978a4-9642-4213-9a28-4cd56f1ba56b service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:27.374112 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749978a4-9642-4213-9a28-4cd56f1ba56b service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:27.431074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:27.431745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:27.432037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:27.432334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] PATH_INFO: `/v3/users/e0c90b4292414b31b3dca39dd6c5ea7f` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:27.433486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c90b4292414b31b3dca39dd6c5ea7f)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:27.435436 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:27.480891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c90b4292414b31b3dca39dd6c5ea7f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.481550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c90b4292414b31b3dca39dd6c5ea7f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.489840 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c90b4292414b31b3dca39dd6c5ea7f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.491800 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:27.504320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c90b4292414b31b3dca39dd6c5ea7f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.511693 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-737d24e1-5e5b-4f2c-bed0-2162d8ec3663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c90b4292414b31b3dca39dd6c5ea7f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.517545 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1358/2719] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:27 2022] DELETE /identity/v3/users/e0c90b4292414b31b3dca39dd6c5ea7f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:27.793102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:27.794862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:27.812015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce55cb20-e105-45d1-a2f7-1755458940b6 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:27.871029 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:27.871688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:27.871961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:27.872273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] PATH_INFO: `/v3/projects/5dc051bb320e4a6e9e141cefc3a386c3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:27.873401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc051bb320e4a6e9e141cefc3a386c3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:27.875301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:27.907636 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:27.925887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc051bb320e4a6e9e141cefc3a386c3', 'request_id': 'req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.933209 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc051bb320e4a6e9e141cefc3a386c3', 'request_id': 'req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.939668 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc051bb320e4a6e9e141cefc3a386c3', 'request_id': 'req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.950384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] The token cache is being invalidate because project 5dc051bb320e4a6e9e141cefc3a386c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:27.950665 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.951296 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-796426f7-af77-4a10-8a9d-bb93bcc9cfbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:27.952805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1362/2720] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:27 2022] DELETE /identity/v3/projects/5dc051bb320e4a6e9e141cefc3a386c3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:27.958587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a890-be7b-4de8-8dbe-3a30492263a6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:27.959066 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a890-be7b-4de8-8dbe-3a30492263a6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:27.959179 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a890-be7b-4de8-8dbe-3a30492263a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:27.981739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9c92a890-be7b-4de8-8dbe-3a30492263a6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:27.982964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9c92a890-be7b-4de8-8dbe-3a30492263a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:28.044547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1359/2721] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:54:28.052967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094212-9cdd-4639-a526-dc63936a3b5a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.053252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094212-9cdd-4639-a526-dc63936a3b5a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.053524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094212-9cdd-4639-a526-dc63936a3b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.072873 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-24094212-9cdd-4639-a526-dc63936a3b5a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:28.074059 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-24094212-9cdd-4639-a526-dc63936a3b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:28.082086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1363/2722] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:28.086669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a890-be7b-4de8-8dbe-3a30492263a6 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.097607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a890-be7b-4de8-8dbe-3a30492263a6 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.102211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.102812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.103089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.103362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.104005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:54:28.104458 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.106071 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.118699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1360/2723] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:54:28.123109 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094212-9cdd-4639-a526-dc63936a3b5a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.132345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094212-9cdd-4639-a526-dc63936a3b5a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.137020 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919bfda-48ec-4eaf-b222-c0303cb2b2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.137611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919bfda-48ec-4eaf-b222-c0303cb2b2a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.137889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919bfda-48ec-4eaf-b222-c0303cb2b2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.138158 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919bfda-48ec-4eaf-b222-c0303cb2b2a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.138787 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919bfda-48ec-4eaf-b222-c0303cb2b2a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.140706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919bfda-48ec-4eaf-b222-c0303cb2b2a1 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.167811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1364/2724] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:28 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:28.172336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.182939 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a92377-7372-4b99-a271-91a9f9324145 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.238733 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70ad9-b81d-4dc5-8bf1-14de8c38b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.239323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70ad9-b81d-4dc5-8bf1-14de8c38b8a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.239604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70ad9-b81d-4dc5-8bf1-14de8c38b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.239878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae70ad9-b81d-4dc5-8bf1-14de8c38b8a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.240531 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae70ad9-b81d-4dc5-8bf1-14de8c38b8a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.242454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae70ad9-b81d-4dc5-8bf1-14de8c38b8a4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.262815 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1361/2725] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:28 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:28.266955 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919bfda-48ec-4eaf-b222-c0303cb2b2a1 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.278295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919bfda-48ec-4eaf-b222-c0303cb2b2a1 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.283119 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0027a-fa64-4b44-b7c5-d1996bb3a3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.283737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0027a-fa64-4b44-b7c5-d1996bb3a3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.284013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0027a-fa64-4b44-b7c5-d1996bb3a3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.284870 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0027a-fa64-4b44-b7c5-d1996bb3a3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.285590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0027a-fa64-4b44-b7c5-d1996bb3a3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.287156 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0027a-fa64-4b44-b7c5-d1996bb3a3b0 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.297338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1365/2726] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:28.301402 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70ad9-b81d-4dc5-8bf1-14de8c38b8a4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.311451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae70ad9-b81d-4dc5-8bf1-14de8c38b8a4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.316148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21f5cdb-34ce-474f-baf6-fe88bbcec832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.316774 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5cdb-34ce-474f-baf6-fe88bbcec832 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.317064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5cdb-34ce-474f-baf6-fe88bbcec832 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.317328 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21f5cdb-34ce-474f-baf6-fe88bbcec832 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.317964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f5cdb-34ce-474f-baf6-fe88bbcec832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.319596 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21f5cdb-34ce-474f-baf6-fe88bbcec832 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.330699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1362/2727] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:28.335282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0027a-fa64-4b44-b7c5-d1996bb3a3b0 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.345168 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0027a-fa64-4b44-b7c5-d1996bb3a3b0 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.350652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211fb66-f869-478a-9f2e-eaa6cfcd7d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.351301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211fb66-f869-478a-9f2e-eaa6cfcd7d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.351582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211fb66-f869-478a-9f2e-eaa6cfcd7d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.351879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211fb66-f869-478a-9f2e-eaa6cfcd7d87 admin admin] PATH_INFO: `/v3/projects/e90d47902f4d413bb756f77ae1b9352c/users/6f8655bce9514658ab2958ebbc69e804/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.366401 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211fb66-f869-478a-9f2e-eaa6cfcd7d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e90d47902f4d413bb756f77ae1b9352c, user_id=6f8655bce9514658ab2958ebbc69e804, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.369054 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211fb66-f869-478a-9f2e-eaa6cfcd7d87 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.382587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1366/2728] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:28 2022] PUT /identity/v3/projects/e90d47902f4d413bb756f77ae1b9352c/users/6f8655bce9514658ab2958ebbc69e804/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:28.392650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd43dd-ded4-4cb3-869d-491b3fc299fd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.392944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd43dd-ded4-4cb3-869d-491b3fc299fd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.393220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd43dd-ded4-4cb3-869d-491b3fc299fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.421646 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-e9bd43dd-ded4-4cb3-869d-491b3fc299fd None None] MFA Rules not processed for user `6f8655bce9514658ab2958ebbc69e804`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:28.422859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e9bd43dd-ded4-4cb3-869d-491b3fc299fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:28.453226 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:28.494502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1363/2729] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:28.498999 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211fb66-f869-478a-9f2e-eaa6cfcd7d87 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.561382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211fb66-f869-478a-9f2e-eaa6cfcd7d87 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.566045 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af768eb-99b5-4cc8-8996-78509d413174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.566639 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af768eb-99b5-4cc8-8996-78509d413174 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.566920 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af768eb-99b5-4cc8-8996-78509d413174 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.567200 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af768eb-99b5-4cc8-8996-78509d413174 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.567840 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af768eb-99b5-4cc8-8996-78509d413174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.569765 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af768eb-99b5-4cc8-8996-78509d413174 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.595737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1367/2730] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:28 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:28.600723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd43dd-ded4-4cb3-869d-491b3fc299fd None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.611308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd43dd-ded4-4cb3-869d-491b3fc299fd None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.667542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badcda5-debc-45a1-b262-b7b7d35c552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.668190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badcda5-debc-45a1-b262-b7b7d35c552d admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.668481 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badcda5-debc-45a1-b262-b7b7d35c552d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.668771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badcda5-debc-45a1-b262-b7b7d35c552d admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.669401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badcda5-debc-45a1-b262-b7b7d35c552d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.671358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9badcda5-debc-45a1-b262-b7b7d35c552d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.692446 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1364/2731] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:28 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:28.696416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af768eb-99b5-4cc8-8996-78509d413174 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.707016 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af768eb-99b5-4cc8-8996-78509d413174 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.711742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c920c6-2f47-484b-ac83-e5452f2e2dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.712365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c920c6-2f47-484b-ac83-e5452f2e2dde admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.712647 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c920c6-2f47-484b-ac83-e5452f2e2dde admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.712919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c920c6-2f47-484b-ac83-e5452f2e2dde admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.713555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c920c6-2f47-484b-ac83-e5452f2e2dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.715131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c920c6-2f47-484b-ac83-e5452f2e2dde admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.725882 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1368/2732] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:28.730135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badcda5-debc-45a1-b262-b7b7d35c552d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.740420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badcda5-debc-45a1-b262-b7b7d35c552d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.745210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a640-561d-4e98-8466-b54fb944c57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.745851 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a640-561d-4e98-8466-b54fb944c57f admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.746129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a640-561d-4e98-8466-b54fb944c57f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.746406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8a640-561d-4e98-8466-b54fb944c57f admin admin] PATH_INFO: `/v3/projects/05af509145a14472a015a9a32290f1d0/users/4d6a08a0fa85474ab9256bb7f7c45ae9/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.761777 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8a640-561d-4e98-8466-b54fb944c57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05af509145a14472a015a9a32290f1d0, user_id=4d6a08a0fa85474ab9256bb7f7c45ae9, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.764512 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8a640-561d-4e98-8466-b54fb944c57f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.778182 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1365/2733] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:28 2022] PUT /identity/v3/projects/05af509145a14472a015a9a32290f1d0/users/4d6a08a0fa85474ab9256bb7f7c45ae9/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:28.782449 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c920c6-2f47-484b-ac83-e5452f2e2dde admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.793474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c920c6-2f47-484b-ac83-e5452f2e2dde admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.813482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:28.853217 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12008c90-65ed-4e7e-ad5d-9c3ed960f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.853826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12008c90-65ed-4e7e-ad5d-9c3ed960f5ab admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.854105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12008c90-65ed-4e7e-ad5d-9c3ed960f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.854377 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12008c90-65ed-4e7e-ad5d-9c3ed960f5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.855027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12008c90-65ed-4e7e-ad5d-9c3ed960f5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.856656 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12008c90-65ed-4e7e-ad5d-9c3ed960f5ab admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.866911 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1369/2734] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:28.871091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a640-561d-4e98-8466-b54fb944c57f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:28.882268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8a640-561d-4e98-8466-b54fb944c57f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:28.886942 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:28.887590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.887878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.888155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] PATH_INFO: `/v3/projects/05af509145a14472a015a9a32290f1d0/users/4d6a08a0fa85474ab9256bb7f7c45ae9/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.890294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05af509145a14472a015a9a32290f1d0, user_id=4d6a08a0fa85474ab9256bb7f7c45ae9, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:28.893299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:28.904775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1366/2735] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:28 2022] PUT /identity/v3/projects/05af509145a14472a015a9a32290f1d0/users/4d6a08a0fa85474ab9256bb7f7c45ae9/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:28.917062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2661-9929-4969-8ef2-816e1c40874f None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:28.917619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2661-9929-4969-8ef2-816e1c40874f None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:28.917619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc2661-9929-4969-8ef2-816e1c40874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:28.946629 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-45fc2661-9929-4969-8ef2-816e1c40874f None None] MFA Rules not processed for user `4d6a08a0fa85474ab9256bb7f7c45ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:28.947868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-45fc2661-9929-4969-8ef2-816e1c40874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:29.017826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1370/2736] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:29.029511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:29.031530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:29.091236 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386d3ec-568f-4196-82d1-f17485f1a503 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:29.094832 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:29.095476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:29.095757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:29.096032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:29.139415 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:29.169572 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:29.171036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:29.180841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1367/2737] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:31.775080 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2661-9929-4969-8ef2-816e1c40874f None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:31.776592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-45fc2661-9929-4969-8ef2-816e1c40874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:31.791093 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc2661-9929-4969-8ef2-816e1c40874f None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:31.795019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:31.795652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:31.795936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:31.796242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:31.806548 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:31.807972 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:31.818333 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1371/2738] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:34.214989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:34.216495 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:34.274047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86856f-5620-4c90-9d96-494d4a366b35 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:34.277601 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:34.278203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:34.278483 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:34.278756 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:34.280550 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:34.342583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:34.344017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:34.354300 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1368/2739] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:37.388237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:37.390022 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:37.497624 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2effec-407e-4322-be4b-3041b3054865 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:37.504959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:37.505574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:37.505850 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:37.506116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:37.508327 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:37.525831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:37.527396 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:37.538282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1372/2740] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:40.703612 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:40.705838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:40.719752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1aff4-98d8-4b39-805f-b8031eb24f90 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:40.728555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:40.729192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:40.729476 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:40.729745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] PATH_INFO: `/v3/users/63e782a27e764b1ca9302094f788815f` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:40.730874 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e782a27e764b1ca9302094f788815f)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:40.732867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:40.784279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e782a27e764b1ca9302094f788815f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:40.785046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e782a27e764b1ca9302094f788815f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:40.793186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e782a27e764b1ca9302094f788815f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:40.806108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e782a27e764b1ca9302094f788815f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:40.813068 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e782a27e764b1ca9302094f788815f'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:40.814519 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:40.820793 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1369/2741] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:40 2022] DELETE /identity/v3/users/63e782a27e764b1ca9302094f788815f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:41.005057 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:41.028028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b2555e-da9b-426b-a765-de76c1e8cfc9 service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:41.048861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:41.095114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:41.095816 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:41.096104 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:41.096797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] PATH_INFO: `/v3/projects/19f4581a35ae41209bb170ebc63b8eec` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:41.098018 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f4581a35ae41209bb170ebc63b8eec)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:41.099962 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:41.152683 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f4581a35ae41209bb170ebc63b8eec', 'request_id': 'req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.159865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f4581a35ae41209bb170ebc63b8eec', 'request_id': 'req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.166416 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f4581a35ae41209bb170ebc63b8eec', 'request_id': 'req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.177386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] The token cache is being invalidate because project 19f4581a35ae41209bb170ebc63b8eec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:41.177676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.178301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.179767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1373/2742] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:41 2022] DELETE /identity/v3/projects/19f4581a35ae41209bb170ebc63b8eec => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:41.183875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:41.185309 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:41.199494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088f3c0-11c2-468b-a9e5-93a9e0c34595 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:41.256185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:41.256855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:41.257349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:41.257670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] PATH_INFO: `/v3/users/65fae5d506444eac8336b78d87d6fd51` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:41.259225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fae5d506444eac8336b78d87d6fd51)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:41.261689 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:41.307173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fae5d506444eac8336b78d87d6fd51'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.307853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fae5d506444eac8336b78d87d6fd51'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.314850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fae5d506444eac8336b78d87d6fd51'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.327488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fae5d506444eac8336b78d87d6fd51'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.334337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fae5d506444eac8336b78d87d6fd51'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.340096 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1370/2743] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:41 2022] DELETE /identity/v3/users/65fae5d506444eac8336b78d87d6fd51 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:41.517896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:41.520241 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:41.533792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93fcf5-0a79-4a52-9db0-9473e0aa2218 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:41.595925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:41.596592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:41.597031 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:41.597540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] PATH_INFO: `/v3/projects/cbb1dc61f7f84f7192767dc11b6cf9d3` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:41.598907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb1dc61f7f84f7192767dc11b6cf9d3)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:41.600939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:41.647149 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb1dc61f7f84f7192767dc11b6cf9d3', 'request_id': 'req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.650749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:41.654545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb1dc61f7f84f7192767dc11b6cf9d3', 'request_id': 'req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.662428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb1dc61f7f84f7192767dc11b6cf9d3', 'request_id': 'req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.674255 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] The token cache is being invalidate because project cbb1dc61f7f84f7192767dc11b6cf9d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:41.674542 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.675306 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7510fbe7-5e0d-4519-91ca-6b7b12b33b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:41.676890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1374/2744] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:41 2022] DELETE /identity/v3/projects/cbb1dc61f7f84f7192767dc11b6cf9d3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:44.731844 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:44.733296 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:44.746437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc5035-6e7b-4fdd-b08d-b2dd6423528e admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:44.801992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:44.802622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:44.802899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:44.803173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] PATH_INFO: `/v3/users/6f8655bce9514658ab2958ebbc69e804` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:44.804327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f8655bce9514658ab2958ebbc69e804)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:44.806265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:44.827200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:44.853740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f8655bce9514658ab2958ebbc69e804'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:44.854377 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f8655bce9514658ab2958ebbc69e804'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:44.861613 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f8655bce9514658ab2958ebbc69e804'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:44.873097 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f8655bce9514658ab2958ebbc69e804'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:44.879717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f8655bce9514658ab2958ebbc69e804'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:44.885679 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1371/2745] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:44 2022] DELETE /identity/v3/users/6f8655bce9514658ab2958ebbc69e804 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:44.890105 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8dbd3-f437-4776-b2e4-fc1eb9c91d0a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:44.890605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8dbd3-f437-4776-b2e4-fc1eb9c91d0a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:44.890729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8dbd3-f437-4776-b2e4-fc1eb9c91d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:44.910931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-1cb8dbd3-f437-4776-b2e4-fc1eb9c91d0a None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:44.912111 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1cb8dbd3-f437-4776-b2e4-fc1eb9c91d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:44.969536 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1375/2746] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:44.979752 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:44.981204 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:45.038524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e184273-0b65-44cc-9fd3-096918e12f43 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:45.042461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b0a86-5985-4050-82a5-bc945568bf88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:45.043088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0a86-5985-4050-82a5-bc945568bf88 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:45.043374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0a86-5985-4050-82a5-bc945568bf88 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:45.043650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b0a86-5985-4050-82a5-bc945568bf88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:45.052711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b0a86-5985-4050-82a5-bc945568bf88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:45.054162 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b0a86-5985-4050-82a5-bc945568bf88 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:45.063529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1372/2747] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:45.331730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8dbd3-f437-4776-b2e4-fc1eb9c91d0a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:45.333202 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-1cb8dbd3-f437-4776-b2e4-fc1eb9c91d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:45.345713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8dbd3-f437-4776-b2e4-fc1eb9c91d0a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:45.351409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:45.352048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:45.352434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:45.352710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] PATH_INFO: `/v3/projects/e90d47902f4d413bb756f77ae1b9352c` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:45.353848 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e90d47902f4d413bb756f77ae1b9352c)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:45.355751 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:45.404948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e90d47902f4d413bb756f77ae1b9352c', 'request_id': 'req-a7407e25-5558-4b93-bd5c-3da5db84b637'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.414270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e90d47902f4d413bb756f77ae1b9352c', 'request_id': 'req-a7407e25-5558-4b93-bd5c-3da5db84b637'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.421130 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e90d47902f4d413bb756f77ae1b9352c', 'request_id': 'req-a7407e25-5558-4b93-bd5c-3da5db84b637'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.434068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] The token cache is being invalidate because project e90d47902f4d413bb756f77ae1b9352c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:45.434354 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.434996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.436518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1376/2748] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:45 2022] DELETE /identity/v3/projects/e90d47902f4d413bb756f77ae1b9352c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:45.440506 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b0a86-5985-4050-82a5-bc945568bf88 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:45.451841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b0a86-5985-4050-82a5-bc945568bf88 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:45.517102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:45.517638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:45.517922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:45.518200 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] PATH_INFO: `/v3/users/4d6a08a0fa85474ab9256bb7f7c45ae9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:45.519373 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d6a08a0fa85474ab9256bb7f7c45ae9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:45.521449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:45.562911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:45.569284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d6a08a0fa85474ab9256bb7f7c45ae9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.570023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d6a08a0fa85474ab9256bb7f7c45ae9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.577734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d6a08a0fa85474ab9256bb7f7c45ae9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.589687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d6a08a0fa85474ab9256bb7f7c45ae9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.596388 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6e0378d1-a5ff-4192-b569-e0bb85d7a330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d6a08a0fa85474ab9256bb7f7c45ae9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:45.602491 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1373/2749] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:45 2022] DELETE /identity/v3/users/4d6a08a0fa85474ab9256bb7f7c45ae9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:45.870154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:45.871717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:45.888319 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7407e25-5558-4b93-bd5c-3da5db84b637 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:45.948281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:45.948939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:45.949172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:45.949442 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] PATH_INFO: `/v3/projects/05af509145a14472a015a9a32290f1d0` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:45.950571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=05af509145a14472a015a9a32290f1d0)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:45.952508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:45.961047 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:46.000546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05af509145a14472a015a9a32290f1d0', 'request_id': 'req-7194747d-c200-4e2b-b398-097271a6f5fb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:46.008409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05af509145a14472a015a9a32290f1d0', 'request_id': 'req-7194747d-c200-4e2b-b398-097271a6f5fb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:46.014568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05af509145a14472a015a9a32290f1d0', 'request_id': 'req-7194747d-c200-4e2b-b398-097271a6f5fb'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:46.025477 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] The token cache is being invalidate because project 05af509145a14472a015a9a32290f1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:46.025764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:46.026397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-7194747d-c200-4e2b-b398-097271a6f5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:46.027865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1377/2750] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:45 2022] DELETE /identity/v3/projects/05af509145a14472a015a9a32290f1d0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:46.032765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641dce-dfb5-4588-9435-0303114d193c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.033253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641dce-dfb5-4588-9435-0303114d193c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.033356 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641dce-dfb5-4588-9435-0303114d193c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.053923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-74641dce-dfb5-4588-9435-0303114d193c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:46.055053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-74641dce-dfb5-4588-9435-0303114d193c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:46.112391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1374/2751] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:46.121201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd69a-3915-4573-89fa-67bd87f26d32 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.121672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd69a-3915-4573-89fa-67bd87f26d32 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.121956 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0febd69a-3915-4573-89fa-67bd87f26d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.143103 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0febd69a-3915-4573-89fa-67bd87f26d32 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:46.144320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0febd69a-3915-4573-89fa-67bd87f26d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:46.152360 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1378/2752] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:46.156574 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641dce-dfb5-4588-9435-0303114d193c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.167091 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641dce-dfb5-4588-9435-0303114d193c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.171678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.172308 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.172590 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.172864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.173514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:54:46.173813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.175426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.190368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1375/2753] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:54:46.194856 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febd69a-3915-4573-89fa-67bd87f26d32 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.204019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0febd69a-3915-4573-89fa-67bd87f26d32 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.209426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617385f-2724-4a9a-b052-25e0912ded6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.210010 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617385f-2724-4a9a-b052-25e0912ded6e admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.210284 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617385f-2724-4a9a-b052-25e0912ded6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.210551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617385f-2724-4a9a-b052-25e0912ded6e admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.211181 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617385f-2724-4a9a-b052-25e0912ded6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.213090 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617385f-2724-4a9a-b052-25e0912ded6e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.240807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1379/2754] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:46 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:46.244956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.255494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19292a13-7aaf-4d24-8e61-c4a4b6673b6d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.312748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2eb17-3c05-454a-9a58-30974520991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.313268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2eb17-3c05-454a-9a58-30974520991d admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.313543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2eb17-3c05-454a-9a58-30974520991d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.313810 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2eb17-3c05-454a-9a58-30974520991d admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.314423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2eb17-3c05-454a-9a58-30974520991d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.316387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2eb17-3c05-454a-9a58-30974520991d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.337341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1376/2755] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:46 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:46.341480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617385f-2724-4a9a-b052-25e0912ded6e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.351879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617385f-2724-4a9a-b052-25e0912ded6e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.356539 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2834531-444d-4397-9937-9920424ee991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.357131 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2834531-444d-4397-9937-9920424ee991 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.357407 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2834531-444d-4397-9937-9920424ee991 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.357674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2834531-444d-4397-9937-9920424ee991 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.358312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2834531-444d-4397-9937-9920424ee991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.359887 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2834531-444d-4397-9937-9920424ee991 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.370257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1380/2756] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:54:46.373989 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2eb17-3c05-454a-9a58-30974520991d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.384116 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2eb17-3c05-454a-9a58-30974520991d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.388728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce499824-e09a-42c6-8e40-d9fd5b7128c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.389320 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499824-e09a-42c6-8e40-d9fd5b7128c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.389599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499824-e09a-42c6-8e40-d9fd5b7128c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.389872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce499824-e09a-42c6-8e40-d9fd5b7128c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.390508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce499824-e09a-42c6-8e40-d9fd5b7128c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.392129 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce499824-e09a-42c6-8e40-d9fd5b7128c9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.402484 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1377/2757] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:46.406474 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2834531-444d-4397-9937-9920424ee991 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.417300 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2834531-444d-4397-9937-9920424ee991 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.421936 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d26a-d9e9-4660-a7f9-2a658f7b91af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.422574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d26a-d9e9-4660-a7f9-2a658f7b91af admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.422853 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d26a-d9e9-4660-a7f9-2a658f7b91af admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.423125 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d26a-d9e9-4660-a7f9-2a658f7b91af admin admin] PATH_INFO: `/v3/projects/d9b9af7ac64f43488fabf84fd1b710aa/users/4821b2f9efdd4a10b2bc0fd47bd211e3/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.437785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d26a-d9e9-4660-a7f9-2a658f7b91af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9b9af7ac64f43488fabf84fd1b710aa, user_id=4821b2f9efdd4a10b2bc0fd47bd211e3, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.440504 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d26a-d9e9-4660-a7f9-2a658f7b91af admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.453077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1381/2758] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:46 2022] PUT /identity/v3/projects/d9b9af7ac64f43488fabf84fd1b710aa/users/4821b2f9efdd4a10b2bc0fd47bd211e3/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:46.465164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80f78-2b9c-4f6f-accb-675cdc0ea6c7 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.465454 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80f78-2b9c-4f6f-accb-675cdc0ea6c7 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.465727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e80f78-2b9c-4f6f-accb-675cdc0ea6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.493507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-81e80f78-2b9c-4f6f-accb-675cdc0ea6c7 None None] MFA Rules not processed for user `4821b2f9efdd4a10b2bc0fd47bd211e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:46.494728 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-81e80f78-2b9c-4f6f-accb-675cdc0ea6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:46.506606 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:46.563753 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1378/2759] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:46.568292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d26a-d9e9-4660-a7f9-2a658f7b91af admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.635814 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d26a-d9e9-4660-a7f9-2a658f7b91af admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.640464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576537fe-259b-451c-ae79-33bbc3470a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.641067 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576537fe-259b-451c-ae79-33bbc3470a85 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.641343 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576537fe-259b-451c-ae79-33bbc3470a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.641617 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576537fe-259b-451c-ae79-33bbc3470a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.642249 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576537fe-259b-451c-ae79-33bbc3470a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.644190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576537fe-259b-451c-ae79-33bbc3470a85 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.671973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1382/2760] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:46 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:46.676126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e80f78-2b9c-4f6f-accb-675cdc0ea6c7 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.687136 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e80f78-2b9c-4f6f-accb-675cdc0ea6c7 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.742669 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe87b6d-8c0e-43bd-8e63-a0009644104f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.743273 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87b6d-8c0e-43bd-8e63-a0009644104f admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.743555 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87b6d-8c0e-43bd-8e63-a0009644104f admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.743826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87b6d-8c0e-43bd-8e63-a0009644104f admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.744488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe87b6d-8c0e-43bd-8e63-a0009644104f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.746433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe87b6d-8c0e-43bd-8e63-a0009644104f admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.768599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1379/2761] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:46 2022] POST /identity/v3/users => generated 302 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:46.773544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576537fe-259b-451c-ae79-33bbc3470a85 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.783833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576537fe-259b-451c-ae79-33bbc3470a85 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.789770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a51ae-b57f-4cda-8181-c7d29b853d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.790369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a51ae-b57f-4cda-8181-c7d29b853d25 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.790644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a51ae-b57f-4cda-8181-c7d29b853d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.790912 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a51ae-b57f-4cda-8181-c7d29b853d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.791550 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a51ae-b57f-4cda-8181-c7d29b853d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.793191 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2a51ae-b57f-4cda-8181-c7d29b853d25 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.804551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1383/2762] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:46.808582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe87b6d-8c0e-43bd-8e63-a0009644104f admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.819373 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe87b6d-8c0e-43bd-8e63-a0009644104f admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.824034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae3ba-4ecf-44d4-a365-b3e2ad8fb0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.824714 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae3ba-4ecf-44d4-a365-b3e2ad8fb0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.824997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae3ba-4ecf-44d4-a365-b3e2ad8fb0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.825272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eae3ba-4ecf-44d4-a365-b3e2ad8fb0f9 admin admin] PATH_INFO: `/v3/projects/f64ef7e9feff43b9a794b207d32ea797/users/8004882be9474ec19f0c4f6619ab3679/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.840710 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eae3ba-4ecf-44d4-a365-b3e2ad8fb0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64ef7e9feff43b9a794b207d32ea797, user_id=8004882be9474ec19f0c4f6619ab3679, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.843387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eae3ba-4ecf-44d4-a365-b3e2ad8fb0f9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.856334 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1380/2763] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:46 2022] PUT /identity/v3/projects/f64ef7e9feff43b9a794b207d32ea797/users/8004882be9474ec19f0c4f6619ab3679/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:46.860247 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a51ae-b57f-4cda-8181-c7d29b853d25 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.870265 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a51ae-b57f-4cda-8181-c7d29b853d25 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.873811 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:46.930185 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b73fc9-5543-4888-8f27-5e832519a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.930789 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b73fc9-5543-4888-8f27-5e832519a2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.931069 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b73fc9-5543-4888-8f27-5e832519a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.931337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b73fc9-5543-4888-8f27-5e832519a2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.931975 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b73fc9-5543-4888-8f27-5e832519a2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.933596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b73fc9-5543-4888-8f27-5e832519a2c2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.944100 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1384/2764] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:46.948214 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae3ba-4ecf-44d4-a365-b3e2ad8fb0f9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:46.958952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eae3ba-4ecf-44d4-a365-b3e2ad8fb0f9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:46.963488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:46.964122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.964430 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.964701 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] PATH_INFO: `/v3/projects/f64ef7e9feff43b9a794b207d32ea797/users/8004882be9474ec19f0c4f6619ab3679/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:46.966594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64ef7e9feff43b9a794b207d32ea797, user_id=8004882be9474ec19f0c4f6619ab3679, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:46.969278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:46.979190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1381/2765] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:46 2022] PUT /identity/v3/projects/f64ef7e9feff43b9a794b207d32ea797/users/8004882be9474ec19f0c4f6619ab3679/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:46.989678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3eb97-8ac0-4298-8edf-56479663814c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:46.990188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3eb97-8ac0-4298-8edf-56479663814c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:46.990290 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3eb97-8ac0-4298-8edf-56479663814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:47.018400 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-02b3eb97-8ac0-4298-8edf-56479663814c None None] MFA Rules not processed for user `8004882be9474ec19f0c4f6619ab3679`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:47.019637 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-02b3eb97-8ac0-4298-8edf-56479663814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:47.086466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1385/2766] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:47.097585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:47.099325 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:47.156548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0838b3d-2300-4b27-8739-2f4c02a7b3a5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:47.160258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f93c-8ec2-45a3-98ec-63bbec9ad66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:47.160964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f93c-8ec2-45a3-98ec-63bbec9ad66e service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:47.161243 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f93c-8ec2-45a3-98ec-63bbec9ad66e service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:47.161523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890f93c-8ec2-45a3-98ec-63bbec9ad66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:47.170594 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890f93c-8ec2-45a3-98ec-63bbec9ad66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:47.172022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890f93c-8ec2-45a3-98ec-63bbec9ad66e service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:47.181812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1382/2767] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:47.228444 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3eb97-8ac0-4298-8edf-56479663814c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:47.229825 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-02b3eb97-8ac0-4298-8edf-56479663814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:47.242540 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3eb97-8ac0-4298-8edf-56479663814c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:47.246096 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313dfb2-7aed-4586-8822-f3018995d6cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:47.246689 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313dfb2-7aed-4586-8822-f3018995d6cf service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:47.246968 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313dfb2-7aed-4586-8822-f3018995d6cf service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:47.247240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313dfb2-7aed-4586-8822-f3018995d6cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:47.307625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313dfb2-7aed-4586-8822-f3018995d6cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:47.309087 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313dfb2-7aed-4586-8822-f3018995d6cf service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:47.317862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1386/2768] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:50.642324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f93c-8ec2-45a3-98ec-63bbec9ad66e service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:50.651996 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:50.705294 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890f93c-8ec2-45a3-98ec-63bbec9ad66e service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:50.710638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:50.711283 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:50.711556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:50.711827 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] PATH_INFO: `/v3/users/4821b2f9efdd4a10b2bc0fd47bd211e3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:50.712975 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4821b2f9efdd4a10b2bc0fd47bd211e3)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:50.714891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:50.761768 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4821b2f9efdd4a10b2bc0fd47bd211e3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:50.762410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4821b2f9efdd4a10b2bc0fd47bd211e3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:50.769944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4821b2f9efdd4a10b2bc0fd47bd211e3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:50.782582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4821b2f9efdd4a10b2bc0fd47bd211e3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:50.790271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4821b2f9efdd4a10b2bc0fd47bd211e3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:50.796046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1383/2769] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:50 2022] DELETE /identity/v3/users/4821b2f9efdd4a10b2bc0fd47bd211e3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:50.800513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c59eea-0238-4742-8ec9-ab5997310bc1 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:50.800997 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c59eea-0238-4742-8ec9-ab5997310bc1 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:50.801099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c59eea-0238-4742-8ec9-ab5997310bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:50.820726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-b8c59eea-0238-4742-8ec9-ab5997310bc1 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:50.821903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b8c59eea-0238-4742-8ec9-ab5997310bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:50.842796 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:50.881638 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1387/2770] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:50.892468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:50.894147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:50.952189 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcdb3f2-8394-4057-8147-d1ddfc672b5c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:50.955893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f731cf-2514-4f9f-9b62-fe7fbf523e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:50.956524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f731cf-2514-4f9f-9b62-fe7fbf523e5c service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:50.956814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f731cf-2514-4f9f-9b62-fe7fbf523e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:50.957094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f731cf-2514-4f9f-9b62-fe7fbf523e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:50.966803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f731cf-2514-4f9f-9b62-fe7fbf523e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:50.968286 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f731cf-2514-4f9f-9b62-fe7fbf523e5c service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:50.978362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1384/2771] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:51.243367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c59eea-0238-4742-8ec9-ab5997310bc1 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:51.244904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b8c59eea-0238-4742-8ec9-ab5997310bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:51.261586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c59eea-0238-4742-8ec9-ab5997310bc1 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:51.266243 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:51.266874 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:51.267256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:51.267447 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] PATH_INFO: `/v3/projects/d9b9af7ac64f43488fabf84fd1b710aa` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:51.268602 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9b9af7ac64f43488fabf84fd1b710aa)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:51.271694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:51.320931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9b9af7ac64f43488fabf84fd1b710aa', 'request_id': 'req-b52c0cac-c521-4930-8726-de62f276dd25'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.328339 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9b9af7ac64f43488fabf84fd1b710aa', 'request_id': 'req-b52c0cac-c521-4930-8726-de62f276dd25'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.335423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9b9af7ac64f43488fabf84fd1b710aa', 'request_id': 'req-b52c0cac-c521-4930-8726-de62f276dd25'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.345990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] The token cache is being invalidate because project d9b9af7ac64f43488fabf84fd1b710aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:51.346274 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.346909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.348674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1388/2772] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:51 2022] DELETE /identity/v3/projects/d9b9af7ac64f43488fabf84fd1b710aa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:51.352583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f731cf-2514-4f9f-9b62-fe7fbf523e5c service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:51.362544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f731cf-2514-4f9f-9b62-fe7fbf523e5c service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:51.394443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:51.426904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:51.427456 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:51.427737 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:51.428011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] PATH_INFO: `/v3/users/8004882be9474ec19f0c4f6619ab3679` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:51.429223 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8004882be9474ec19f0c4f6619ab3679)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:51.431151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:51.478581 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8004882be9474ec19f0c4f6619ab3679'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.479250 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8004882be9474ec19f0c4f6619ab3679'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.486956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8004882be9474ec19f0c4f6619ab3679'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.500011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8004882be9474ec19f0c4f6619ab3679'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.507778 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-5e6c266e-87e5-4937-9440-61f3d3d642f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8004882be9474ec19f0c4f6619ab3679'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.517319 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1385/2773] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:51 2022] DELETE /identity/v3/users/8004882be9474ec19f0c4f6619ab3679 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:51.799521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:51.801068 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:51.817702 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52c0cac-c521-4930-8726-de62f276dd25 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:51.876294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:51.876925 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:51.877198 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:51.877469 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] PATH_INFO: `/v3/projects/f64ef7e9feff43b9a794b207d32ea797` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:51.878667 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64ef7e9feff43b9a794b207d32ea797)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:51.881336 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:51.929286 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64ef7e9feff43b9a794b207d32ea797', 'request_id': 'req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.931805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:51.938623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64ef7e9feff43b9a794b207d32ea797', 'request_id': 'req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.947908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64ef7e9feff43b9a794b207d32ea797', 'request_id': 'req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.959743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] The token cache is being invalidate because project f64ef7e9feff43b9a794b207d32ea797 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:51.960475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.960706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-ab20dcf3-a36c-4246-a5db-8cf9d15912c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:51.962170 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1389/2774] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:51 2022] DELETE /identity/v3/projects/f64ef7e9feff43b9a794b207d32ea797 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:51.966979 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f573d08-a7e7-4deb-8bb9-bed5958b521e None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:51.967522 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f573d08-a7e7-4deb-8bb9-bed5958b521e None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:51.967794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f573d08-a7e7-4deb-8bb9-bed5958b521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:51.988836 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-3f573d08-a7e7-4deb-8bb9-bed5958b521e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:51.990421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3f573d08-a7e7-4deb-8bb9-bed5958b521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:52.049978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1386/2775] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:52.057967 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763511f4-5e01-448f-b286-0f874f4d667c None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.058251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763511f4-5e01-448f-b286-0f874f4d667c None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.058590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763511f4-5e01-448f-b286-0f874f4d667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.078165 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-763511f4-5e01-448f-b286-0f874f4d667c None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:52.079346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-763511f4-5e01-448f-b286-0f874f4d667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:52.088134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1390/2776] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:52.093022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f573d08-a7e7-4deb-8bb9-bed5958b521e None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:52.102847 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f573d08-a7e7-4deb-8bb9-bed5958b521e None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:52.107448 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:52.108072 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.108441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.108717 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.109367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:54:52.109672 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:52.111277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:52.122589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1387/2777] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 09:54:52.126945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763511f4-5e01-448f-b286-0f874f4d667c None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:52.136907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763511f4-5e01-448f-b286-0f874f4d667c None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:52.141682 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39237a-e4bd-4c48-8697-6485cd7bced3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:52.142273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39237a-e4bd-4c48-8697-6485cd7bced3 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.142555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39237a-e4bd-4c48-8697-6485cd7bced3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.142827 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39237a-e4bd-4c48-8697-6485cd7bced3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.143454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39237a-e4bd-4c48-8697-6485cd7bced3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:52.146076 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39237a-e4bd-4c48-8697-6485cd7bced3 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:52.174721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1391/2778] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:52 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:52.178913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:52.189004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f3e1b-4282-4cc1-94dc-c79183c676ee admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:52.222959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:52.248229 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e57147-c1ec-4965-86cf-6d1650246142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:52.248829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57147-c1ec-4965-86cf-6d1650246142 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.249110 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57147-c1ec-4965-86cf-6d1650246142 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.249385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e57147-c1ec-4965-86cf-6d1650246142 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.250014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e57147-c1ec-4965-86cf-6d1650246142 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:52.251971 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e57147-c1ec-4965-86cf-6d1650246142 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:52.273923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1388/2779] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:52 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:52.278177 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39237a-e4bd-4c48-8697-6485cd7bced3 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:52.289033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39237a-e4bd-4c48-8697-6485cd7bced3 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:52.293927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef08e55-2b79-4706-bfe3-4e4356835c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:52.294520 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef08e55-2b79-4706-bfe3-4e4356835c46 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.294799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef08e55-2b79-4706-bfe3-4e4356835c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.295070 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef08e55-2b79-4706-bfe3-4e4356835c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.295710 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef08e55-2b79-4706-bfe3-4e4356835c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:52.297324 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef08e55-2b79-4706-bfe3-4e4356835c46 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:52.307072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1392/2780] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:54:52.310871 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e57147-c1ec-4965-86cf-6d1650246142 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:52.321082 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e57147-c1ec-4965-86cf-6d1650246142 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:52.325877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b824cbc-5b86-41c4-983d-09514555a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:52.326468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824cbc-5b86-41c4-983d-09514555a035 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.326748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824cbc-5b86-41c4-983d-09514555a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.327021 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b824cbc-5b86-41c4-983d-09514555a035 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.327654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824cbc-5b86-41c4-983d-09514555a035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:52.329303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b824cbc-5b86-41c4-983d-09514555a035 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:52.339950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1389/2781] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:52.344218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef08e55-2b79-4706-bfe3-4e4356835c46 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:52.355196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef08e55-2b79-4706-bfe3-4e4356835c46 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:52.359846 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:52.360522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.360803 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.361074 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] PATH_INFO: `/v3/projects/a57175c02b9b45bbbd93db7d68ccd0ec/users/b84abd3ee1034b32b296ed2b9202a5de/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.375586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a57175c02b9b45bbbd93db7d68ccd0ec, user_id=b84abd3ee1034b32b296ed2b9202a5de, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:52.378251 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:52.391038 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1393/2782] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:52 2022] PUT /identity/v3/projects/a57175c02b9b45bbbd93db7d68ccd0ec/users/b84abd3ee1034b32b296ed2b9202a5de/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:52.402919 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686789fb-ca3d-437b-b41c-551be023df42 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.403190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686789fb-ca3d-437b-b41c-551be023df42 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.403494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686789fb-ca3d-437b-b41c-551be023df42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.434929 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-686789fb-ca3d-437b-b41c-551be023df42 None None] MFA Rules not processed for user `b84abd3ee1034b32b296ed2b9202a5de`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:52.436160 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-686789fb-ca3d-437b-b41c-551be023df42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:52.498855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1390/2783] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:52.510182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:52.511869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:52.570373 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaf5650-16b0-4a4e-b7c6-a3d09549f94f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:52.574126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:52.574730 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:52.575017 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:52.575292 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:52.584291 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:52.585653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:52.595404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1394/2784] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:54.082293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305c0fa-2f06-494d-a52a-8fd1546d97a5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:54.082813 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305c0fa-2f06-494d-a52a-8fd1546d97a5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:54.083502 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305c0fa-2f06-494d-a52a-8fd1546d97a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:54.117094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-6305c0fa-2f06-494d-a52a-8fd1546d97a5 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:54.118332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6305c0fa-2f06-494d-a52a-8fd1546d97a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:54.185069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1391/2785] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:54.230713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:54.232159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:54.307678 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ddfa3-67ce-4535-8ad2-c22133ecbc52 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:54.312592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657677a-edd6-4a02-90b3-6c9196fd9ab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:54.313194 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657677a-edd6-4a02-90b3-6c9196fd9ab2 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:54.313471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657677a-edd6-4a02-90b3-6c9196fd9ab2 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:54.313740 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657677a-edd6-4a02-90b3-6c9196fd9ab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:54.321791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657677a-edd6-4a02-90b3-6c9196fd9ab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:54.323350 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657677a-edd6-4a02-90b3-6c9196fd9ab2 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:54.331268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1395/2786] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:54:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:54:58.158315 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305c0fa-2f06-494d-a52a-8fd1546d97a5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:58.209602 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:58.231032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305c0fa-2f06-494d-a52a-8fd1546d97a5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:58.235683 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:58.236386 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:58.236801 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:58.237213 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] PATH_INFO: `/v3/users/b84abd3ee1034b32b296ed2b9202a5de` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:58.238468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84abd3ee1034b32b296ed2b9202a5de)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:58.241643 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:58.302183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84abd3ee1034b32b296ed2b9202a5de'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:58.302951 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84abd3ee1034b32b296ed2b9202a5de'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:58.313792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84abd3ee1034b32b296ed2b9202a5de'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:58.330888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84abd3ee1034b32b296ed2b9202a5de'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:58.339852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84abd3ee1034b32b296ed2b9202a5de'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:58.346406 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1392/2787] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:54:58 2022] DELETE /identity/v3/users/b84abd3ee1034b32b296ed2b9202a5de => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:58.351700 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f681e-6900-47b1-9242-cc08a107f82b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:58.352235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f681e-6900-47b1-9242-cc08a107f82b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:58.352341 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f681e-6900-47b1-9242-cc08a107f82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:58.373387 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5d8f681e-6900-47b1-9242-cc08a107f82b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:58.374595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5d8f681e-6900-47b1-9242-cc08a107f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:58.382529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:58.463013 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1396/2788] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:54:58.469855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:58.472009 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:58.554703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3330bb-188b-4596-9832-be2f95faf220 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:58.558530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0680f75-9cef-42e2-9d2d-ccadd8aa640c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:58.559257 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680f75-9cef-42e2-9d2d-ccadd8aa640c service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:58.559636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680f75-9cef-42e2-9d2d-ccadd8aa640c service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:58.559950 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0680f75-9cef-42e2-9d2d-ccadd8aa640c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:58.570541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0680f75-9cef-42e2-9d2d-ccadd8aa640c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:58.572047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0680f75-9cef-42e2-9d2d-ccadd8aa640c service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:58.588852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1393/2789] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:54:58.975116 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f681e-6900-47b1-9242-cc08a107f82b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:58.982218 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5d8f681e-6900-47b1-9242-cc08a107f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:59.003510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f681e-6900-47b1-9242-cc08a107f82b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:59.018726 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:59.020487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.020970 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.021419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] PATH_INFO: `/v3/projects/a57175c02b9b45bbbd93db7d68ccd0ec` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.034172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a57175c02b9b45bbbd93db7d68ccd0ec)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:59.037228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:59.104986 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a57175c02b9b45bbbd93db7d68ccd0ec', 'request_id': 'req-057c90c1-454c-4541-96df-7b7843367f03'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:59.115820 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a57175c02b9b45bbbd93db7d68ccd0ec', 'request_id': 'req-057c90c1-454c-4541-96df-7b7843367f03'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:59.124261 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a57175c02b9b45bbbd93db7d68ccd0ec', 'request_id': 'req-057c90c1-454c-4541-96df-7b7843367f03'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:59.137762 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] The token cache is being invalidate because project a57175c02b9b45bbbd93db7d68ccd0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:54:59.138046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:59.138734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-057c90c1-454c-4541-96df-7b7843367f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:54:59.143767 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1397/2790] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:54:58 2022] DELETE /identity/v3/projects/a57175c02b9b45bbbd93db7d68ccd0ec => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:54:59.146212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e9f2-3407-4500-9aac-192161b819a5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.146740 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e9f2-3407-4500-9aac-192161b819a5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.147019 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9e9f2-3407-4500-9aac-192161b819a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.169723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-83f9e9f2-3407-4500-9aac-192161b819a5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:59.170952 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-83f9e9f2-3407-4500-9aac-192161b819a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:59.240122 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1394/2791] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:59.248091 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8f85-b7a2-4fa5-a259-895944feb248 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.248512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8f85-b7a2-4fa5-a259-895944feb248 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.248838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d8f85-b7a2-4fa5-a259-895944feb248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.273095 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-201d8f85-b7a2-4fa5-a259-895944feb248 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:59.275204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-201d8f85-b7a2-4fa5-a259-895944feb248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:59.285127 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1398/2792] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:54:59.294147 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9e9f2-3407-4500-9aac-192161b819a5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:59.302282 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:59.308420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9e9f2-3407-4500-9aac-192161b819a5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:59.324057 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:59.325556 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.325870 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.326132 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.326803 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:54:59.327113 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:59.329181 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:59.350532 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1395/2793] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:54:59.355099 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d8f85-b7a2-4fa5-a259-895944feb248 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:59.366040 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d8f85-b7a2-4fa5-a259-895944feb248 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:59.370807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1826-5ae2-4272-bee2-890995c311a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:59.371611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1826-5ae2-4272-bee2-890995c311a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.371728 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1826-5ae2-4272-bee2-890995c311a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.371952 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b1826-5ae2-4272-bee2-890995c311a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.372644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b1826-5ae2-4272-bee2-890995c311a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:59.374554 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b1826-5ae2-4272-bee2-890995c311a5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:59.410315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1399/2794] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:59 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:54:59.415626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:59.428027 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba5584-db10-4202-8c42-00dffbb5dd01 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:59.492133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8434df-120a-49a7-899e-baef35faba0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:59.492703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8434df-120a-49a7-899e-baef35faba0d admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.492992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8434df-120a-49a7-899e-baef35faba0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.493267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8434df-120a-49a7-899e-baef35faba0d admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.493923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8434df-120a-49a7-899e-baef35faba0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:59.495886 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8434df-120a-49a7-899e-baef35faba0d admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:59.523567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1396/2795] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:59 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:54:59.527844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1826-5ae2-4272-bee2-890995c311a5 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:59.539332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b1826-5ae2-4272-bee2-890995c311a5 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:59.544506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9058080-fd12-442b-a2c6-cb4e352f4220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:59.545151 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058080-fd12-442b-a2c6-cb4e352f4220 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.545432 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058080-fd12-442b-a2c6-cb4e352f4220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.545706 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9058080-fd12-442b-a2c6-cb4e352f4220 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.546355 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9058080-fd12-442b-a2c6-cb4e352f4220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:59.547976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9058080-fd12-442b-a2c6-cb4e352f4220 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:59.559871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1400/2796] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:54:59.563616 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8434df-120a-49a7-899e-baef35faba0d admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:59.575530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8434df-120a-49a7-899e-baef35faba0d admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:59.580695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0219b95-5b7d-47c7-ba85-5388c982eceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:59.581357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219b95-5b7d-47c7-ba85-5388c982eceb admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.581636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219b95-5b7d-47c7-ba85-5388c982eceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.581917 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0219b95-5b7d-47c7-ba85-5388c982eceb admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.582554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0219b95-5b7d-47c7-ba85-5388c982eceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:59.585037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0219b95-5b7d-47c7-ba85-5388c982eceb admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:59.603172 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1397/2797] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:54:59.604351 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9058080-fd12-442b-a2c6-cb4e352f4220 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:59.615909 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9058080-fd12-442b-a2c6-cb4e352f4220 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:59.622763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271060-db9d-43f7-abb4-efa38024ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:59.623475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271060-db9d-43f7-abb4-efa38024ed32 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.623757 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271060-db9d-43f7-abb4-efa38024ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.624032 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d271060-db9d-43f7-abb4-efa38024ed32 admin admin] PATH_INFO: `/v3/projects/c2142b479c7346fc8470fe52599cfbb9/users/dc2af466d3a94840af6ac13b63b371ad/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.645880 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d271060-db9d-43f7-abb4-efa38024ed32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2142b479c7346fc8470fe52599cfbb9, user_id=dc2af466d3a94840af6ac13b63b371ad, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:59.648833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d271060-db9d-43f7-abb4-efa38024ed32 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:59.672645 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1401/2798] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:54:59 2022] PUT /identity/v3/projects/c2142b479c7346fc8470fe52599cfbb9/users/dc2af466d3a94840af6ac13b63b371ad/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:54:59.678014 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872e77d-7519-4f2b-bfd8-b4925ae8092c None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.678438 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872e77d-7519-4f2b-bfd8-b4925ae8092c None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.678638 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872e77d-7519-4f2b-bfd8-b4925ae8092c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.710392 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9872e77d-7519-4f2b-bfd8-b4925ae8092c None None] MFA Rules not processed for user `dc2af466d3a94840af6ac13b63b371ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:54:59.713058 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9872e77d-7519-4f2b-bfd8-b4925ae8092c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:54:59.805772 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1398/2799] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:54:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:54:59.813838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271060-db9d-43f7-abb4-efa38024ed32 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:59.867405 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:54:59.914961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d271060-db9d-43f7-abb4-efa38024ed32 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:54:59.920048 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8d830-e6c3-4093-9c2a-1f0c07362580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:54:59.920871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8d830-e6c3-4093-9c2a-1f0c07362580 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:54:59.921154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8d830-e6c3-4093-9c2a-1f0c07362580 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:54:59.921436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8d830-e6c3-4093-9c2a-1f0c07362580 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:54:59.922122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8d830-e6c3-4093-9c2a-1f0c07362580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:54:59.924112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8d830-e6c3-4093-9c2a-1f0c07362580 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:54:59.958305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1402/2800] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:54:59 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 09:54:59.959530 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872e77d-7519-4f2b-bfd8-b4925ae8092c None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:54:59.983041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872e77d-7519-4f2b-bfd8-b4925ae8092c None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:00.061064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9089e7b-f512-425f-9d6e-5083160470e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:00.061677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9089e7b-f512-425f-9d6e-5083160470e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:00.062088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9089e7b-f512-425f-9d6e-5083160470e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:00.062426 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9089e7b-f512-425f-9d6e-5083160470e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:00.063001 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9089e7b-f512-425f-9d6e-5083160470e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:00.065120 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9089e7b-f512-425f-9d6e-5083160470e2 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:00.076948 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:00.107211 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1399/2801] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:54:59 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:55:00.111135 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8d830-e6c3-4093-9c2a-1f0c07362580 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:00.125172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8d830-e6c3-4093-9c2a-1f0c07362580 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:00.132375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13f336-9050-40d4-8884-aab4e9c2e9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:00.132993 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13f336-9050-40d4-8884-aab4e9c2e9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:00.133275 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13f336-9050-40d4-8884-aab4e9c2e9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:00.133627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13f336-9050-40d4-8884-aab4e9c2e9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:00.134242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13f336-9050-40d4-8884-aab4e9c2e9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:00.136023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13f336-9050-40d4-8884-aab4e9c2e9d0 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:00.151215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1403/2802] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:55:00.155158 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9089e7b-f512-425f-9d6e-5083160470e2 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:00.173396 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9089e7b-f512-425f-9d6e-5083160470e2 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:00.179956 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba9993-cd75-425a-ba10-c0663e6d24a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:00.181081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba9993-cd75-425a-ba10-c0663e6d24a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:00.181407 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba9993-cd75-425a-ba10-c0663e6d24a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:00.181684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba9993-cd75-425a-ba10-c0663e6d24a1 admin admin] PATH_INFO: `/v3/projects/b00b038798ba42f9afabe7bd90e42381/users/31a813a33a80405fa8d9ed1cda192640/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:00.200127 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba9993-cd75-425a-ba10-c0663e6d24a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00b038798ba42f9afabe7bd90e42381, user_id=31a813a33a80405fa8d9ed1cda192640, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:00.204579 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba9993-cd75-425a-ba10-c0663e6d24a1 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:00.227034 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1400/2803] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:55:00 2022] PUT /identity/v3/projects/b00b038798ba42f9afabe7bd90e42381/users/31a813a33a80405fa8d9ed1cda192640/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:55:00.231358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13f336-9050-40d4-8884-aab4e9c2e9d0 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:00.244652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13f336-9050-40d4-8884-aab4e9c2e9d0 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:00.330334 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c49d05-2d04-4937-b74d-2a1582e2b0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:00.331688 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49d05-2d04-4937-b74d-2a1582e2b0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:00.332482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49d05-2d04-4937-b74d-2a1582e2b0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:00.333147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c49d05-2d04-4937-b74d-2a1582e2b0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:00.334113 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49d05-2d04-4937-b74d-2a1582e2b0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:00.336563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c49d05-2d04-4937-b74d-2a1582e2b0b9 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:00.349533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1404/2804] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:55:00.353389 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba9993-cd75-425a-ba10-c0663e6d24a1 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:00.365640 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba9993-cd75-425a-ba10-c0663e6d24a1 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:00.373904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:00.374816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:00.375101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:00.375378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] PATH_INFO: `/v3/projects/b00b038798ba42f9afabe7bd90e42381/users/31a813a33a80405fa8d9ed1cda192640/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:00.377529 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b00b038798ba42f9afabe7bd90e42381, user_id=31a813a33a80405fa8d9ed1cda192640, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:00.380808 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:00.392916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1401/2805] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:55:00 2022] PUT /identity/v3/projects/b00b038798ba42f9afabe7bd90e42381/users/31a813a33a80405fa8d9ed1cda192640/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:55:00.405283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109d0e-c22b-4d98-b4d1-0c35c442d2dd None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:00.406041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109d0e-c22b-4d98-b4d1-0c35c442d2dd None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:00.406041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27109d0e-c22b-4d98-b4d1-0c35c442d2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:00.442293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-27109d0e-c22b-4d98-b4d1-0c35c442d2dd None None] MFA Rules not processed for user `31a813a33a80405fa8d9ed1cda192640`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:55:00.445380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-27109d0e-c22b-4d98-b4d1-0c35c442d2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:00.551254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1405/2806] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:55:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:55:00.556124 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:00.558739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:00.651623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341a9d2-12de-4d49-a1bd-83bf3aaa6953 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:00.658290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc44d88-f095-479d-ab05-4e4630bfc3e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:00.658923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44d88-f095-479d-ab05-4e4630bfc3e5 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:00.659348 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44d88-f095-479d-ab05-4e4630bfc3e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:00.659636 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44d88-f095-479d-ab05-4e4630bfc3e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:00.768595 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc44d88-f095-479d-ab05-4e4630bfc3e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:00.770102 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc44d88-f095-479d-ab05-4e4630bfc3e5 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:00.783105 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1402/2807] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:55:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:55:03.461281 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27109d0e-c22b-4d98-b4d1-0c35c442d2dd None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:03.493987 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:03.541595 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27109d0e-c22b-4d98-b4d1-0c35c442d2dd None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:03.546532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:03.547282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:03.547584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:03.547861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] PATH_INFO: `/v3/users/dc2af466d3a94840af6ac13b63b371ad` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:03.549110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2af466d3a94840af6ac13b63b371ad)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:03.551436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:03.609531 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2af466d3a94840af6ac13b63b371ad'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:03.626097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2af466d3a94840af6ac13b63b371ad'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:03.626914 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2af466d3a94840af6ac13b63b371ad'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:03.627557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2af466d3a94840af6ac13b63b371ad'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:03.638884 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2af466d3a94840af6ac13b63b371ad'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:03.653186 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1406/2808] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:55:03 2022] DELETE /identity/v3/users/dc2af466d3a94840af6ac13b63b371ad => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:55:03.658010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28964-7a7e-49eb-bb32-87fd09ae02f5 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:03.658913 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28964-7a7e-49eb-bb32-87fd09ae02f5 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:03.659194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e28964-7a7e-49eb-bb32-87fd09ae02f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:03.681518 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-33e28964-7a7e-49eb-bb32-87fd09ae02f5 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:55:03.682908 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-33e28964-7a7e-49eb-bb32-87fd09ae02f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:03.763344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1403/2809] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:55:03.773690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:03.775322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:03.843552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ad526-7b66-4f1c-9995-ac7ce0829d03 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:03.852443 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9dd1-7570-4c0b-8ae4-e0003b749ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:03.853384 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9dd1-7570-4c0b-8ae4-e0003b749ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:03.853908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9dd1-7570-4c0b-8ae4-e0003b749ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:03.854562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e9dd1-7570-4c0b-8ae4-e0003b749ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:03.867779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e9dd1-7570-4c0b-8ae4-e0003b749ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:03.869447 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e9dd1-7570-4c0b-8ae4-e0003b749ae3 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:03.888854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1407/2810] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:55:04.220999 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e28964-7a7e-49eb-bb32-87fd09ae02f5 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:04.228207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-33e28964-7a7e-49eb-bb32-87fd09ae02f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:04.241156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e28964-7a7e-49eb-bb32-87fd09ae02f5 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:04.247022 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:04.247675 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:04.247964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:04.248329 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] PATH_INFO: `/v3/projects/c2142b479c7346fc8470fe52599cfbb9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:04.249487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2142b479c7346fc8470fe52599cfbb9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:04.251546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:04.253451 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:04.306947 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2142b479c7346fc8470fe52599cfbb9', 'request_id': 'req-b20c9547-e4b3-460e-a04d-16bc2bd45697'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.314322 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2142b479c7346fc8470fe52599cfbb9', 'request_id': 'req-b20c9547-e4b3-460e-a04d-16bc2bd45697'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.320883 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2142b479c7346fc8470fe52599cfbb9', 'request_id': 'req-b20c9547-e4b3-460e-a04d-16bc2bd45697'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.332125 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] The token cache is being invalidate because project c2142b479c7346fc8470fe52599cfbb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:55:04.332445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.333624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.335467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1404/2811] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:55:04 2022] DELETE /identity/v3/projects/c2142b479c7346fc8470fe52599cfbb9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:55:04.339522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9dd1-7570-4c0b-8ae4-e0003b749ae3 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:04.350144 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e9dd1-7570-4c0b-8ae4-e0003b749ae3 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:04.400620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:04.425662 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:04.426297 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:04.426576 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:04.426899 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] PATH_INFO: `/v3/users/31a813a33a80405fa8d9ed1cda192640` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:04.428561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31a813a33a80405fa8d9ed1cda192640)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:04.430805 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:04.479378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31a813a33a80405fa8d9ed1cda192640'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.491854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31a813a33a80405fa8d9ed1cda192640'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.492651 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31a813a33a80405fa8d9ed1cda192640'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.493338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31a813a33a80405fa8d9ed1cda192640'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.501399 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-84ba0486-08e2-4b55-a34b-59ae4ff30c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31a813a33a80405fa8d9ed1cda192640'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.514270 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1408/2812] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:55:04 2022] DELETE /identity/v3/users/31a813a33a80405fa8d9ed1cda192640 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:55:04.808946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:04.810472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:04.827623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20c9547-e4b3-460e-a04d-16bc2bd45697 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:04.895635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:04.896304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:04.896727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:04.897012 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] PATH_INFO: `/v3/projects/b00b038798ba42f9afabe7bd90e42381` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:04.898256 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b00b038798ba42f9afabe7bd90e42381)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:04.900317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:04.953327 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b00b038798ba42f9afabe7bd90e42381', 'request_id': 'req-35ae8489-4845-4416-8a02-4fab28edc65c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.962690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b00b038798ba42f9afabe7bd90e42381', 'request_id': 'req-35ae8489-4845-4416-8a02-4fab28edc65c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.971231 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b00b038798ba42f9afabe7bd90e42381', 'request_id': 'req-35ae8489-4845-4416-8a02-4fab28edc65c'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.983829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] The token cache is being invalidate because project b00b038798ba42f9afabe7bd90e42381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:55:04.984205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.984858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-35ae8489-4845-4416-8a02-4fab28edc65c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:55:04.986540 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1405/2813] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:55:04 2022] DELETE /identity/v3/projects/b00b038798ba42f9afabe7bd90e42381 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:55:08.197490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cbcd7-bb05-4af6-8602-15e98afb6df0 None None] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:08.198024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cbcd7-bb05-4af6-8602-15e98afb6df0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:08.198024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cbcd7-bb05-4af6-8602-15e98afb6df0 None None] PATH_INFO: `/` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:08.199435 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1409/2814] 10.222.0.18 () {54 vars in 921 bytes} [Wed Aug 31 09:55:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 09:55:08.204431 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8945abb-13d2-4e02-ac1c-a1911fd0bb26 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:08.204853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8945abb-13d2-4e02-ac1c-a1911fd0bb26 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:08.204958 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8945abb-13d2-4e02-ac1c-a1911fd0bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:08.226093 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-a8945abb-13d2-4e02-ac1c-a1911fd0bb26 None None] MFA Rules not processed for user `0365be92a5d54c8ea32fd003a5619a70`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:55:08.227314 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a8945abb-13d2-4e02-ac1c-a1911fd0bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:08.241054 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:08.301046 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1406/2815] 10.222.0.18 () {58 vars in 1018 bytes} [Wed Aug 31 09:55:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:55:08.312896 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cbcd7-bb05-4af6-8602-15e98afb6df0 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:08.314694 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-219cbcd7-bb05-4af6-8602-15e98afb6df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:08.381623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cbcd7-bb05-4af6-8602-15e98afb6df0 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:08.385301 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a32741-5728-4f29-b6db-299438789451 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c0bf4de3a1442c8b856efbfac436fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:08.385904 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a32741-5728-4f29-b6db-299438789451 service glance] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:08.386182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a32741-5728-4f29-b6db-299438789451 service glance] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:08.386451 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a32741-5728-4f29-b6db-299438789451 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:08.397037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a32741-5728-4f29-b6db-299438789451 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:08.398457 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a32741-5728-4f29-b6db-299438789451 service glance] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:08.409033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1410/2816] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:55:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:55:14.858421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cf54a-7487-4baa-987c-8de678b28734 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:14.858927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cf54a-7487-4baa-987c-8de678b28734 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:14.859041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cf54a-7487-4baa-987c-8de678b28734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:14.878152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b56cf54a-7487-4baa-987c-8de678b28734 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:55:14.879354 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b56cf54a-7487-4baa-987c-8de678b28734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:14.935161 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1407/2817] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:55:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:55:14.947114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a32741-5728-4f29-b6db-299438789451 service glance] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:14.948527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-87a32741-5728-4f29-b6db-299438789451 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:15.016922 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a32741-5728-4f29-b6db-299438789451 service glance] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:15.021883 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56493aee-fd65-4b7c-93bf-531ebf33fb7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:15.022490 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56493aee-fd65-4b7c-93bf-531ebf33fb7a service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:15.023415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56493aee-fd65-4b7c-93bf-531ebf33fb7a service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:15.023769 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56493aee-fd65-4b7c-93bf-531ebf33fb7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:15.031640 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56493aee-fd65-4b7c-93bf-531ebf33fb7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:15.033256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56493aee-fd65-4b7c-93bf-531ebf33fb7a service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:15.036679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:15.042759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1411/2818] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:55:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:24.928252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=47 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:25.046322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:34.258212 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d55ce-c496-4570-b16c-f9bb32f58038 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:34.259343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d55ce-c496-4570-b16c-f9bb32f58038 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:34.259343 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5d55ce-c496-4570-b16c-f9bb32f58038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:34.278410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9f5d55ce-c496-4570-b16c-f9bb32f58038 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:55:34.279607 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9f5d55ce-c496-4570-b16c-f9bb32f58038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:55:34.286766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1408/2819] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 31 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:55:34.299014 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56493aee-fd65-4b7c-93bf-531ebf33fb7a service swift] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:55:34.310184 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56493aee-fd65-4b7c-93bf-531ebf33fb7a service swift] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:55:34.315137 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:55:34.315718 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:55:34.315996 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:55:34.316304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:55:34.324918 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:55:34.326508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:55:34.334616 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1412/2820] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:55:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:55:44.273496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:55:44.331512 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:31.001465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d55ce-c496-4570-b16c-f9bb32f58038 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:56:31.002899 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9f5d55ce-c496-4570-b16c-f9bb32f58038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:56:31.063891 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5d55ce-c496-4570-b16c-f9bb32f58038 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:56:31.067510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:56:31.068117 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:56:31.068433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:56:31.068705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:56:31.070467 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:56:31.085101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:56:31.086472 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:56:31.098070 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1409/2821] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:56:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:56:33.773942 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:56:33.775549 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:56:33.834039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c29bfa5-d16e-4a3c-a4f0-aae1469e0b78 service swift] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:56:33.837632 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9867a8-2446-4900-9e7c-d510c5ce13b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:56:33.838228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9867a8-2446-4900-9e7c-d510c5ce13b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:56:33.838502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9867a8-2446-4900-9e7c-d510c5ce13b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:56:33.838774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9867a8-2446-4900-9e7c-d510c5ce13b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:56:33.840491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ee9867a8-2446-4900-9e7c-d510c5ce13b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:56:33.853953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9867a8-2446-4900-9e7c-d510c5ce13b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:56:33.855368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9867a8-2446-4900-9e7c-d510c5ce13b4 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:56:33.866908 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1413/2822] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:56:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:56:35.862770 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:56:35.864250 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:56:35.881428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b78ab-e541-4ec8-a3d1-6a33d164cf57 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:56:35.895420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:56:35.896094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:56:35.896419 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:56:35.896725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:56:35.898914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:56:35.916285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:56:35.918118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:56:35.943918 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1410/2823] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:56:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:56:39.413367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7149e-c7e8-4fca-b879-0738af573c21 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:56:39.413891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7149e-c7e8-4fca-b879-0738af573c21 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:56:39.413891 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7149e-c7e8-4fca-b879-0738af573c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:56:39.433737 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-59f7149e-c7e8-4fca-b879-0738af573c21 None None] MFA Rules not processed for user `5a481c138d994aee9db3ae7a161a735b`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:56:39.434921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-59f7149e-c7e8-4fca-b879-0738af573c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:56:39.491318 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1414/2824] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:56:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:56:42.127794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:56:42.137981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7826cb-599e-4a7c-a023-650018c8e4b3 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:56:42.142457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:56:42.143345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:56:42.143634 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:56:42.143914 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:56:42.145769 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:56:42.156510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:56:42.158374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:56:42.167736 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1411/2825] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:56:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:56:49.483945 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=51 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:56:52.163306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=38 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:57:59.349299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7149e-c7e8-4fca-b879-0738af573c21 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:57:59.350810 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-59f7149e-c7e8-4fca-b879-0738af573c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:57:59.367725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7149e-c7e8-4fca-b879-0738af573c21 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:57:59.373839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e76fb0-fb98-4ff4-9ab4-c0438bca49ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:57:59.374434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76fb0-fb98-4ff4-9ab4-c0438bca49ef service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:57:59.374711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76fb0-fb98-4ff4-9ab4-c0438bca49ef service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:57:59.374977 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e76fb0-fb98-4ff4-9ab4-c0438bca49ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:57:59.376790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f4e76fb0-fb98-4ff4-9ab4-c0438bca49ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:57:59.388448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e76fb0-fb98-4ff4-9ab4-c0438bca49ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:57:59.390065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e76fb0-fb98-4ff4-9ab4-c0438bca49ef service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:57:59.400799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1415/2826] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:57:59 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:58:09.395573 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:14.629165 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:58:14.643993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba926a-160a-4812-83f2-c60764304148 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:58:14.649724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:58:14.650357 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:14.650644 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:14.650944 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:14.652896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:14.668316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:58:14.669965 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:58:14.681724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1412/2827] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:58:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:58:15.774812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2852e1-5912-4029-8217-5a79c08e7319 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:15.775335 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2852e1-5912-4029-8217-5a79c08e7319 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:15.775446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2852e1-5912-4029-8217-5a79c08e7319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:15.832900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-bc2852e1-5912-4029-8217-5a79c08e7319 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:58:15.835436 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bc2852e1-5912-4029-8217-5a79c08e7319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:15.857935 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1416/2828] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:58:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:58:15.907150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:58:15.930819 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb749e-3b49-4215-b5c9-315f052116d5 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:58:15.936435 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85494553-e9af-402c-a4a3-e2b022a0a150 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:58:15.937387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494553-e9af-402c-a4a3-e2b022a0a150 service swift] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:15.937658 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494553-e9af-402c-a4a3-e2b022a0a150 service swift] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:15.937935 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85494553-e9af-402c-a4a3-e2b022a0a150 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:15.947154 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85494553-e9af-402c-a4a3-e2b022a0a150 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:58:15.949351 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85494553-e9af-402c-a4a3-e2b022a0a150 service swift] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:58:15.958690 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1413/2829] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:58:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:25.854413 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=18 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:25.954973 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=16 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:29.685792 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2852e1-5912-4029-8217-5a79c08e7319 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:58:29.687215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-bc2852e1-5912-4029-8217-5a79c08e7319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:29.700739 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2852e1-5912-4029-8217-5a79c08e7319 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:58:29.704484 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:58:29.705090 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:29.705366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:29.705634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:29.707375 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:29.720845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:58:29.720845 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:58:29.728866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1417/2830] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:58:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:58:29.806831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85494553-e9af-402c-a4a3-e2b022a0a150 service swift] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:58:29.817111 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85494553-e9af-402c-a4a3-e2b022a0a150 service swift] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:58:29.820745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f97767b-0330-41d5-836e-eab57507ef58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:58:29.821352 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97767b-0330-41d5-836e-eab57507ef58 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:29.821635 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97767b-0330-41d5-836e-eab57507ef58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:29.821910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f97767b-0330-41d5-836e-eab57507ef58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:29.823670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0f97767b-0330-41d5-836e-eab57507ef58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:29.838605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97767b-0330-41d5-836e-eab57507ef58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:58:29.840074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f97767b-0330-41d5-836e-eab57507ef58 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:58:29.852552 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1414/2831] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:58:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:58:29.917340 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:58:29.919579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:30.010625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f907cf6-0a8c-465b-9ac9-c7b5f3952da3 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:58:30.017505 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:58:30.018226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:30.018508 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:30.018779 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:30.020745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:30.035072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:58:30.036743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:58:30.048365 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1418/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:58:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:58:31.763796 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b79d1-1cf3-4e39-a330-88b4e1203034 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:31.764374 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b79d1-1cf3-4e39-a330-88b4e1203034 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:31.764490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b79d1-1cf3-4e39-a330-88b4e1203034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:31.785264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-925b79d1-1cf3-4e39-a330-88b4e1203034 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:58:31.786499 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-925b79d1-1cf3-4e39-a330-88b4e1203034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:31.794812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1415/2833] 10.222.0.18 () {58 vars in 1009 bytes} [Wed Aug 31 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:58:31.806809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:58:31.820868 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0139c-b87d-4d8c-9550-df172a1cc667 service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:58:31.826028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df74b93-2b8a-4579-9489-06f190d144c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:58:31.826660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df74b93-2b8a-4579-9489-06f190d144c6 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:31.826941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df74b93-2b8a-4579-9489-06f190d144c6 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:31.827216 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df74b93-2b8a-4579-9489-06f190d144c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:31.842644 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df74b93-2b8a-4579-9489-06f190d144c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:58:31.844331 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df74b93-2b8a-4579-9489-06f190d144c6 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:58:31.853630 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1419/2834] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:58:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 09:58:41.779812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=9 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:41.850077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=44 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:48.579461 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad50d8-6579-42ad-886c-4a7f210d4435 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:48.579959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad50d8-6579-42ad-886c-4a7f210d4435 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:48.580130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad50d8-6579-42ad-886c-4a7f210d4435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:48.601824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-85ad50d8-6579-42ad-886c-4a7f210d4435 None None] MFA Rules not processed for user `c0419feb9d4649a592c1d187ce807faa`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:58:48.603051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-85ad50d8-6579-42ad-886c-4a7f210d4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:58:48.610655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1416/2835] 10.222.0.18 () {58 vars in 967 bytes} [Wed Aug 31 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:58:48.623052 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df74b93-2b8a-4579-9489-06f190d144c6 service swift] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:58:48.634528 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df74b93-2b8a-4579-9489-06f190d144c6 service swift] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:58:48.640332 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777a16-cd9f-4c3d-b24f-c67ef5877271 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda7a66a7e054a968f8f633762a1c79b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:58:48.641717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777a16-cd9f-4c3d-b24f-c67ef5877271 service swift] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:58:48.642002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777a16-cd9f-4c3d-b24f-c67ef5877271 service swift] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:58:48.642273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9777a16-cd9f-4c3d-b24f-c67ef5877271 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:58:48.650857 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777a16-cd9f-4c3d-b24f-c67ef5877271 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:58:48.652519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9777a16-cd9f-4c3d-b24f-c67ef5877271 service swift] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:58:48.661456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1420/2836] 10.222.0.18 () {60 vars in 1384 bytes} [Wed Aug 31 09:58:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 09:58:58.596718 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:58:58.657833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=6 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:41.688758 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad50d8-6579-42ad-886c-4a7f210d4435 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:41.690912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-85ad50d8-6579-42ad-886c-4a7f210d4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:41.712765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad50d8-6579-42ad-886c-4a7f210d4435 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:41.719259 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:41.719961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:41.720462 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:41.720894 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:41.723824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:41.739954 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:41.742452 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:41.756711 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1417/2837] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:59:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:59:47.883608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777a16-cd9f-4c3d-b24f-c67ef5877271 service swift] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:47.895465 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9777a16-cd9f-4c3d-b24f-c67ef5877271 service swift] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:47.899412 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:47.900023 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:47.900487 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:47.900770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:47.902579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:47.990043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:47.993044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:48.004983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1421/2838] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:59:51.750437 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=6 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:51.891457 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:51.915463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7ae74-3a75-4f84-a6bc-c7226a83e2a4 service placement] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:51.925633 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:51.926656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:51.927723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:51.927723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:51.930744 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:51.950846 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:51.954474 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:51.975877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1418/2839] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:59:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 09:59:51.976537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:51.978562 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:51.992760 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87c346-2b96-483f-beea-a6bd8f7136e5 service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:52.002829 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:52.003964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:52.003964 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:52.004571 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] PATH_INFO: `/v3/users/5a481c138d994aee9db3ae7a161a735b` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:52.006072 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a481c138d994aee9db3ae7a161a735b)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:52.008434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:52.084625 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a481c138d994aee9db3ae7a161a735b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.098917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a481c138d994aee9db3ae7a161a735b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.099798 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a481c138d994aee9db3ae7a161a735b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.102849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a481c138d994aee9db3ae7a161a735b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.115437 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9efd0825-11aa-4250-98b3-7a3707a110e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a481c138d994aee9db3ae7a161a735b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.133344 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1422/2840] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 09:59:51 2022] DELETE /identity/v3/users/5a481c138d994aee9db3ae7a161a735b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:59:52.370177 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:52.390170 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62351cd8-5227-45ac-8eb7-3d449d955a6c service placement] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:52.470238 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:52.470928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:52.471272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:52.471639 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] PATH_INFO: `/v3/projects/b23db7377f9c47de9bf28f01aefc7c5e` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:52.472912 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23db7377f9c47de9bf28f01aefc7c5e)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:52.474889 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:52.551814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23db7377f9c47de9bf28f01aefc7c5e', 'request_id': 'req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.563681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23db7377f9c47de9bf28f01aefc7c5e', 'request_id': 'req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.577494 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23db7377f9c47de9bf28f01aefc7c5e', 'request_id': 'req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.598023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] The token cache is being invalidate because project b23db7377f9c47de9bf28f01aefc7c5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 09:59:52.598657 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.599904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-b875a8db-a549-4d9d-b0b6-4d27d916ba7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 09:59:52.604237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1419/2841] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 09:59:52 2022] DELETE /identity/v3/projects/b23db7377f9c47de9bf28f01aefc7c5e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 09:59:52.613055 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255af02-e96e-432c-9fbb-dd394f29f89e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:52.613498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255af02-e96e-432c-9fbb-dd394f29f89e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:52.615046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255af02-e96e-432c-9fbb-dd394f29f89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:52.644661 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5255af02-e96e-432c-9fbb-dd394f29f89e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:59:52.645783 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5255af02-e96e-432c-9fbb-dd394f29f89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:52.737862 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1423/2842] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:59:52.751304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f6cd3-9a28-4d80-9821-6a1dcf84ab94 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:52.751904 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f6cd3-9a28-4d80-9821-6a1dcf84ab94 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:52.752104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f6cd3-9a28-4d80-9821-6a1dcf84ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:52.775910 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-8e7f6cd3-9a28-4d80-9821-6a1dcf84ab94 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:59:52.777272 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-8e7f6cd3-9a28-4d80-9821-6a1dcf84ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:52.786681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1420/2843] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:59:52.791395 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255af02-e96e-432c-9fbb-dd394f29f89e None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:52.802824 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255af02-e96e-432c-9fbb-dd394f29f89e None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:52.811322 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:52.812394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:52.812791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:52.813717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:52.814778 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 09:59:52.815203 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:52.816924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:52.818833 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:52.831279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1424/2844] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 09:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 09:59:52.836210 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f6cd3-9a28-4d80-9821-6a1dcf84ab94 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:52.852703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f6cd3-9a28-4d80-9821-6a1dcf84ab94 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:52.861324 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092573a5-ca1b-451b-8b53-8d541fd74dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:52.862086 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092573a5-ca1b-451b-8b53-8d541fd74dcf admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:52.862422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092573a5-ca1b-451b-8b53-8d541fd74dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:52.862779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092573a5-ca1b-451b-8b53-8d541fd74dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:52.863567 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092573a5-ca1b-451b-8b53-8d541fd74dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:52.865629 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092573a5-ca1b-451b-8b53-8d541fd74dcf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:52.928302 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1421/2845] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 09:59:52 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:59:52.933958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:52.947577 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa2d246-2cf0-483e-ba9d-aaa8ec068057 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:53.035809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c6fff-ef09-4af7-a302-9d5d37c4014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:53.036567 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6fff-ef09-4af7-a302-9d5d37c4014e admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:53.036725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6fff-ef09-4af7-a302-9d5d37c4014e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:53.041985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c6fff-ef09-4af7-a302-9d5d37c4014e admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:53.041985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c6fff-ef09-4af7-a302-9d5d37c4014e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:53.041985 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c6fff-ef09-4af7-a302-9d5d37c4014e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:53.065477 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1425/2846] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 09:59:52 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 09:59:53.069980 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092573a5-ca1b-451b-8b53-8d541fd74dcf admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:53.081292 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092573a5-ca1b-451b-8b53-8d541fd74dcf admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:53.086725 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78561d-a9e6-460e-8a8b-7e2aa3d7179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:53.087429 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78561d-a9e6-460e-8a8b-7e2aa3d7179b admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:53.087811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78561d-a9e6-460e-8a8b-7e2aa3d7179b admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:53.088267 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78561d-a9e6-460e-8a8b-7e2aa3d7179b admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:53.089078 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78561d-a9e6-460e-8a8b-7e2aa3d7179b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:53.091126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78561d-a9e6-460e-8a8b-7e2aa3d7179b admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:53.103037 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1422/2847] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 09:59:53.107257 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c6fff-ef09-4af7-a302-9d5d37c4014e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:53.119230 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c6fff-ef09-4af7-a302-9d5d37c4014e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:53.126034 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b85bf4-2316-43bd-93a2-c416a56171d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:53.126657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b85bf4-2316-43bd-93a2-c416a56171d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:53.126939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b85bf4-2316-43bd-93a2-c416a56171d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:53.127220 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b85bf4-2316-43bd-93a2-c416a56171d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:53.127877 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b85bf4-2316-43bd-93a2-c416a56171d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:53.129570 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b85bf4-2316-43bd-93a2-c416a56171d5 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:53.142196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1426/2848] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 09:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 09:59:53.148559 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78561d-a9e6-460e-8a8b-7e2aa3d7179b admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:53.163372 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78561d-a9e6-460e-8a8b-7e2aa3d7179b admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:53.168587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:53.169293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:53.169569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:53.169853 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] PATH_INFO: `/v3/projects/ddf27157cb314d83a279a3c666c4b196/users/4456d19f63c645cc833793e34a9e36b7/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:53.191946 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf27157cb314d83a279a3c666c4b196, user_id=4456d19f63c645cc833793e34a9e36b7, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:53.194661 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:53.219591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1423/2849] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 09:59:53 2022] PUT /identity/v3/projects/ddf27157cb314d83a279a3c666c4b196/users/4456d19f63c645cc833793e34a9e36b7/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 09:59:53.226419 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c5d1-4532-42b9-8fd8-e931ffa86c0e None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:53.226703 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c5d1-4532-42b9-8fd8-e931ffa86c0e None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:53.226980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216c5d1-4532-42b9-8fd8-e931ffa86c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:53.247527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4216c5d1-4532-42b9-8fd8-e931ffa86c0e None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:59:53.248777 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4216c5d1-4532-42b9-8fd8-e931ffa86c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:53.326428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1427/2850] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 09:59:53.337355 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:53.339152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:53.346577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 09:59:53.413726 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab0b9-0fa3-4daa-9cdf-993c5b3bc090 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:53.417786 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:53.418724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:53.419005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:53.419285 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:53.430089 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:53.431549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:53.444802 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1424/2851] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 09:59:58.549937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272a22-66fc-4c9d-967f-8d8faaaa4d93 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:58.550495 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272a22-66fc-4c9d-967f-8d8faaaa4d93 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:58.551219 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d272a22-66fc-4c9d-967f-8d8faaaa4d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:58.600049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6d272a22-66fc-4c9d-967f-8d8faaaa4d93 None None] MFA Rules not processed for user `4456d19f63c645cc833793e34a9e36b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 09:59:58.601918 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6d272a22-66fc-4c9d-967f-8d8faaaa4d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:58.705079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1428/2852] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 09:59:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 09:59:58.741408 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 09:59:58.746350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 09:59:58.855095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861cae0-fea1-46be-b7b4-8ab602de65c6 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 09:59:58.862420 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 09:59:58.863053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 09:59:58.863341 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 09:59:58.863620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 09:59:58.873053 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 09:59:58.874743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 09:59:58.886369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1425/2853] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 09:59:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:00:00.763394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78e02-d1cc-4de1-9a94-ae1fbb470ad5 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:00:00.764150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78e02-d1cc-4de1-9a94-ae1fbb470ad5 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:00:00.764150 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e78e02-d1cc-4de1-9a94-ae1fbb470ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:00:00.772019 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:00.788780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-59e78e02-d1cc-4de1-9a94-ae1fbb470ad5 None None] MFA Rules not processed for user `4456d19f63c645cc833793e34a9e36b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:00:00.790024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-59e78e02-d1cc-4de1-9a94-ae1fbb470ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:00:00.798973 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1429/2854] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:00:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:00:01.227032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:00:01.228964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:00:01.243004 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84616ca8-c1be-4d2f-b7ba-d849a82b5fdd service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:00:01.246817 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:00:01.247422 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:00:01.247903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:00:01.248209 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:00:01.250604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:00:01.262677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:00:01.264288 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:00:01.278005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1426/2855] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:00:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:00:10.786160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:00:11.273677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=64 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:26.511380 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717fe2-13e7-4b92-a9d1-650093fec715 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:01:26.512012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717fe2-13e7-4b92-a9d1-650093fec715 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:01:26.512012 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36717fe2-13e7-4b92-a9d1-650093fec715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:01:26.537481 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-36717fe2-13e7-4b92-a9d1-650093fec715 None None] MFA Rules not processed for user `4456d19f63c645cc833793e34a9e36b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:01:26.539468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-36717fe2-13e7-4b92-a9d1-650093fec715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:01:26.547844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1430/2856] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:01:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:01:26.932017 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:01:26.944038 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59db3a2-ec5b-4722-8c80-23147d47f15a service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:01:26.949306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:01:26.949968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:01:26.950253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:01:26.950533 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:01:26.952729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:01:26.971047 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:01:26.974031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:01:26.985767 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1427/2857] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:01:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:01:32.440560 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36717fe2-13e7-4b92-a9d1-650093fec715 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:01:32.456988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36717fe2-13e7-4b92-a9d1-650093fec715 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:01:32.461924 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:01:32.462608 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:01:32.463049 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:01:32.463299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:01:32.465182 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:01:32.480110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:01:32.481605 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:01:32.494358 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1431/2858] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:01:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:01:33.766311 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:01:33.777897 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527ca41-a633-4f72-9cb8-5a8877045184 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:01:33.785247 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:01:33.786459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:01:33.786459 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:01:33.786909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:01:33.788580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:01:33.809216 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:01:33.811723 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:01:33.826605 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1428/2859] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:01:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:01:40.292398 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:01:40.306807 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f7bbd-9a8d-45f2-9c03-9300460d2c1d service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:01:40.314750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f45a6-fe49-447b-bb61-c6158514b4f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:01:40.315526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f45a6-fe49-447b-bb61-c6158514b4f8 service nova] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:01:40.315921 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f45a6-fe49-447b-bb61-c6158514b4f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:01:40.316349 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f45a6-fe49-447b-bb61-c6158514b4f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:01:40.318506 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ec9f45a6-fe49-447b-bb61-c6158514b4f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:01:40.333376 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f45a6-fe49-447b-bb61-c6158514b4f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:01:40.334976 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f45a6-fe49-447b-bb61-c6158514b4f8 service nova] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:01:40.350745 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1432/2860] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:01:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:01:40.628760 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:01:40.637729 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae813d52-eb90-4de1-8328-1bf02afb0a4c service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:01:40.641961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:01:40.642561 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:01:40.642838 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:01:40.643107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:01:40.645173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:01:40.658696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:01:40.661703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:01:40.674088 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1429/2861] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:01:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:01:50.345179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=15 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:01:50.668959 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=18 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:03:23.476585 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1ce7-abc1-4ebb-aff1-93e2cddeb194 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:03:23.477475 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1ce7-abc1-4ebb-aff1-93e2cddeb194 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:03:23.477648 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1ce7-abc1-4ebb-aff1-93e2cddeb194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:03:23.499879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f79d1ce7-abc1-4ebb-aff1-93e2cddeb194 None None] MFA Rules not processed for user `4456d19f63c645cc833793e34a9e36b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:03:23.501134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f79d1ce7-abc1-4ebb-aff1-93e2cddeb194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:03:23.508126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1433/2862] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:03:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:03:33.493679 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:03:34.267536 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:03:34.284792 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed837505-118f-4c56-82a2-d2938c8abb99 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:03:34.291824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:03:34.292501 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:03:34.292785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:03:34.293061 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:03:34.294993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:03:34.312855 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:03:34.315730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:03:34.328705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1430/2863] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:03:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:03:44.322805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=6 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:04:58.353362 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1ce7-abc1-4ebb-aff1-93e2cddeb194 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:04:58.354835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f79d1ce7-abc1-4ebb-aff1-93e2cddeb194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:04:58.464974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1ce7-abc1-4ebb-aff1-93e2cddeb194 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:04:58.468698 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0b900-c3c7-40de-8b4e-8ece9ed9a4f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:04:58.469316 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b900-c3c7-40de-8b4e-8ece9ed9a4f5 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:04:58.469596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b900-c3c7-40de-8b4e-8ece9ed9a4f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:04:58.469866 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0b900-c3c7-40de-8b4e-8ece9ed9a4f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:04:58.493466 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0b900-c3c7-40de-8b4e-8ece9ed9a4f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:04:58.494927 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c0b900-c3c7-40de-8b4e-8ece9ed9a4f5 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:04:58.504409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1434/2864] 10.222.0.18 () {60 vars in 1396 bytes} [Wed Aug 31 10:04:58 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:05:01.970153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:05:01.971621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:05:02.149553 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb990c5-5ac8-4692-86a2-918b70b47874 service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:05:02.155234 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:05:02.155856 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:05:02.156137 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:05:02.156442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:05:02.158265 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:05:02.172254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:05:02.174877 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:05:02.187409 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1431/2865] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:05:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:05:07.471305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fee569-0dd2-4d48-8034-e5fa068e0c93 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:05:07.472138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fee569-0dd2-4d48-8034-e5fa068e0c93 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:05:07.472138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fee569-0dd2-4d48-8034-e5fa068e0c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:05:07.491489 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-23fee569-0dd2-4d48-8034-e5fa068e0c93 None None] MFA Rules not processed for user `4456d19f63c645cc833793e34a9e36b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:05:07.492758 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-23fee569-0dd2-4d48-8034-e5fa068e0c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:05:07.501056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1435/2866] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:05:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:05:07.820650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:05:07.841083 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a931b16-b999-4888-a333-f447e71453bc service placement] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:05:07.844731 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:05:07.845358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:05:07.845642 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:05:07.845923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:05:07.854618 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:05:07.856081 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:05:07.864443 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1432/2867] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:05:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:05:08.196235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fee569-0dd2-4d48-8034-e5fa068e0c93 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:05:08.209611 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fee569-0dd2-4d48-8034-e5fa068e0c93 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:05:08.215981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:05:08.216643 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:05:08.217283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:05:08.217653 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:05:08.219658 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:05:08.234743 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:05:08.236458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:05:08.252471 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1436/2868] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:05:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:05:17.860662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=73 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:05:18.243176 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=63 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:36.899993 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:36.901220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:36.914585 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e33be-3ba5-4c9e-b3b2-d21d2bad723c service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:36.918517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:36.919133 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:36.919410 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:36.919684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:36.939611 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:36.941201 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:36.970928 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1433/2869] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:06:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:06:39.707497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:39.718108 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bc50e-9a9f-4876-99b2-10246ed06c58 service placement] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:39.722894 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cad36-ffcc-44f8-8fa6-a7374c8fc5d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:39.723759 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cad36-ffcc-44f8-8fa6-a7374c8fc5d5 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:39.724007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cad36-ffcc-44f8-8fa6-a7374c8fc5d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:39.724521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cad36-ffcc-44f8-8fa6-a7374c8fc5d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:39.739386 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cad36-ffcc-44f8-8fa6-a7374c8fc5d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:39.740871 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cad36-ffcc-44f8-8fa6-a7374c8fc5d5 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:39.757221 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1437/2870] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:06:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:06:44.271460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:44.273393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:44.317509 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d873f-07ec-41c3-85bc-5e52169c4c8d service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:44.324826 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e0b4d-7ef9-4a18-afb8-b913a6075e7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0365be92a5d54c8ea32fd003a5619a70', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:44.325766 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e0b4d-7ef9-4a18-afb8-b913a6075e7a service nova] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:44.326428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e0b4d-7ef9-4a18-afb8-b913a6075e7a service nova] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:44.326923 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e0b4d-7ef9-4a18-afb8-b913a6075e7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:44.341313 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e0b4d-7ef9-4a18-afb8-b913a6075e7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:44.344562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e0b4d-7ef9-4a18-afb8-b913a6075e7a service nova] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:44.366385 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1434/2871] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:06:49.453043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cad36-ffcc-44f8-8fa6-a7374c8fc5d5 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:49.462692 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cad36-ffcc-44f8-8fa6-a7374c8fc5d5 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:49.466409 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15ed8-d46a-4af3-88e2-0efa97038d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:49.467005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15ed8-d46a-4af3-88e2-0efa97038d0b service neutron] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:49.467283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15ed8-d46a-4af3-88e2-0efa97038d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:49.467552 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e15ed8-d46a-4af3-88e2-0efa97038d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:49.477337 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e15ed8-d46a-4af3-88e2-0efa97038d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:49.478839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e15ed8-d46a-4af3-88e2-0efa97038d0b service neutron] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:49.508404 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1438/2872] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:06:52.766754 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e0b4d-7ef9-4a18-afb8-b913a6075e7a service nova] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:52.778968 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e0b4d-7ef9-4a18-afb8-b913a6075e7a service nova] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:52.789051 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:52.790005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:52.790291 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:52.790563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:52.792684 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:52.811749 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:52.813562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:52.828703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1435/2873] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:06:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:06:52.861445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15ed8-d46a-4af3-88e2-0efa97038d0b service neutron] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:52.877583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e15ed8-d46a-4af3-88e2-0efa97038d0b service neutron] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:52.883028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:52.883677 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:52.883958 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:52.884279 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] PATH_INFO: `/v3/users/4456d19f63c645cc833793e34a9e36b7` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:52.885454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4456d19f63c645cc833793e34a9e36b7)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:52.887468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:52.950179 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4456d19f63c645cc833793e34a9e36b7'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:52.968519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4456d19f63c645cc833793e34a9e36b7'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:52.969708 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4456d19f63c645cc833793e34a9e36b7'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:52.970480 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4456d19f63c645cc833793e34a9e36b7'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:52.981095 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-019ac4d6-ca9c-4cfa-9a9f-1ba5c7b00dfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4456d19f63c645cc833793e34a9e36b7'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:52.997011 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1439/2874] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 10:06:52 2022] DELETE /identity/v3/users/4456d19f63c645cc833793e34a9e36b7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:06:53.196023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:53.207149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcaa29b-9d9f-4429-abf7-1f19db6b9344 service placement] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:53.289421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:53.290069 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.290347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.290621 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] PATH_INFO: `/v3/projects/ddf27157cb314d83a279a3c666c4b196` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.291872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf27157cb314d83a279a3c666c4b196)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:53.293850 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:53.349808 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf27157cb314d83a279a3c666c4b196', 'request_id': 'req-12a560c1-e549-42a5-98b3-98e739d2f9e6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:53.359610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf27157cb314d83a279a3c666c4b196', 'request_id': 'req-12a560c1-e549-42a5-98b3-98e739d2f9e6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:53.368414 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf27157cb314d83a279a3c666c4b196', 'request_id': 'req-12a560c1-e549-42a5-98b3-98e739d2f9e6'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:53.394031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] The token cache is being invalidate because project ddf27157cb314d83a279a3c666c4b196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88102) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:06:53.394031 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:53.395686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-12a560c1-e549-42a5-98b3-98e739d2f9e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:06:53.400909 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1436/2875] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 10:06:53 2022] DELETE /identity/v3/projects/ddf27157cb314d83a279a3c666c4b196 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:06:53.402681 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bbc2-df1c-4e8c-8b4d-af8776583a7d None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.403051 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bbc2-df1c-4e8c-8b4d-af8776583a7d None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.403272 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13bbc2-df1c-4e8c-8b4d-af8776583a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.474308 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-5d13bbc2-df1c-4e8c-8b4d-af8776583a7d None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:06:53.475631 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-5d13bbc2-df1c-4e8c-8b4d-af8776583a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:53.535546 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:53.545434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1440/2876] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:06:53.553739 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bd1dd-8fbf-450c-941b-02f07962dcb6 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.554041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bd1dd-8fbf-450c-941b-02f07962dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.554323 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bd1dd-8fbf-450c-941b-02f07962dcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.575306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-4a8bd1dd-8fbf-450c-941b-02f07962dcb6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:06:53.576604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-4a8bd1dd-8fbf-450c-941b-02f07962dcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:53.585687 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1437/2877] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:06:53.591240 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bbc2-df1c-4e8c-8b4d-af8776583a7d None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:53.601915 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13bbc2-df1c-4e8c-8b4d-af8776583a7d None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:53.607028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:53.607642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.608009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.608372 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] PATH_INFO: `/v3/domains` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.609584 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88101) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:06:53.610065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:53.611526 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:53.626953 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1441/2878] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 10:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:06:53.631878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bd1dd-8fbf-450c-941b-02f07962dcb6 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:53.642276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8bd1dd-8fbf-450c-941b-02f07962dcb6 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:53.647332 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b00cd-6ffd-4f41-8b15-3f662a9c3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:53.647936 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b00cd-6ffd-4f41-8b15-3f662a9c3409 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.648248 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b00cd-6ffd-4f41-8b15-3f662a9c3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.648520 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b00cd-6ffd-4f41-8b15-3f662a9c3409 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.649194 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b00cd-6ffd-4f41-8b15-3f662a9c3409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:53.651135 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b00cd-6ffd-4f41-8b15-3f662a9c3409 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:53.656713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:53.684901 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1438/2879] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 10:06:53 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:06:53.689189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:53.700748 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5976e98b-4039-4dfc-8d3a-b6d7f588e24c admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:53.763620 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fd20f-3ec5-4506-bd38-b6e1abeba1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:53.764261 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd20f-3ec5-4506-bd38-b6e1abeba1ab admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.764544 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd20f-3ec5-4506-bd38-b6e1abeba1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.765378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fd20f-3ec5-4506-bd38-b6e1abeba1ab admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.766077 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fd20f-3ec5-4506-bd38-b6e1abeba1ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:53.768215 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fd20f-3ec5-4506-bd38-b6e1abeba1ab admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:53.790497 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1442/2880] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 10:06:53 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:06:53.794997 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b00cd-6ffd-4f41-8b15-3f662a9c3409 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:53.806279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b00cd-6ffd-4f41-8b15-3f662a9c3409 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:53.812576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a875-185f-4cce-84e6-d65f0a7115a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:53.813365 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a875-185f-4cce-84e6-d65f0a7115a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.813654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a875-185f-4cce-84e6-d65f0a7115a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.813934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d6a875-185f-4cce-84e6-d65f0a7115a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.814583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6a875-185f-4cce-84e6-d65f0a7115a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:53.816228 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d6a875-185f-4cce-84e6-d65f0a7115a5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:53.826278 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1439/2881] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:06:53.830434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fd20f-3ec5-4506-bd38-b6e1abeba1ab admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:53.840468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fd20f-3ec5-4506-bd38-b6e1abeba1ab admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:53.845587 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2e435-27fe-4349-bd79-d1e6aeff04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:53.846175 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2e435-27fe-4349-bd79-d1e6aeff04e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.846454 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2e435-27fe-4349-bd79-d1e6aeff04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.846736 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2e435-27fe-4349-bd79-d1e6aeff04e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.847366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2e435-27fe-4349-bd79-d1e6aeff04e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:53.848982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2e435-27fe-4349-bd79-d1e6aeff04e6 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:53.860842 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1443/2882] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:06:53.866442 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a875-185f-4cce-84e6-d65f0a7115a5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:53.879630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d6a875-185f-4cce-84e6-d65f0a7115a5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:53.885166 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c7aa-dbe4-432e-84a4-fb83224559ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:53.885872 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c7aa-dbe4-432e-84a4-fb83224559ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.886153 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c7aa-dbe4-432e-84a4-fb83224559ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.886433 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4937c7aa-dbe4-432e-84a4-fb83224559ce admin admin] PATH_INFO: `/v3/projects/082c08f165694516bf95d86426707331/users/b2c070474e2241e482d7bf0cce274ef9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.908049 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c7aa-dbe4-432e-84a4-fb83224559ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=082c08f165694516bf95d86426707331, user_id=b2c070474e2241e482d7bf0cce274ef9, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:53.911188 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4937c7aa-dbe4-432e-84a4-fb83224559ce admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:53.932580 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1440/2883] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:06:53 2022] PUT /identity/v3/projects/082c08f165694516bf95d86426707331/users/b2c070474e2241e482d7bf0cce274ef9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:06:53.945065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f696-c985-4d5c-8136-b19d694843d7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:53.945652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f696-c985-4d5c-8136-b19d694843d7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:53.945652 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f429f696-c985-4d5c-8136-b19d694843d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:53.978164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f429f696-c985-4d5c-8136-b19d694843d7 None None] MFA Rules not processed for user `b2c070474e2241e482d7bf0cce274ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:06:53.981201 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f429f696-c985-4d5c-8136-b19d694843d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:54.051691 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1444/2884] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:06:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:06:54.056791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c7aa-dbe4-432e-84a4-fb83224559ce admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.126771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4937c7aa-dbe4-432e-84a4-fb83224559ce admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.131428 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6dc7-7134-449c-a662-a8b55e307553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.132028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6dc7-7134-449c-a662-a8b55e307553 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.132337 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6dc7-7134-449c-a662-a8b55e307553 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.132610 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b6dc7-7134-449c-a662-a8b55e307553 admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.133353 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6dc7-7134-449c-a662-a8b55e307553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.135469 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b6dc7-7134-449c-a662-a8b55e307553 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.164440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1441/2885] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 10:06:54 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:06:54.168780 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429f696-c985-4d5c-8136-b19d694843d7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.181606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f429f696-c985-4d5c-8136-b19d694843d7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.234126 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:54.242157 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa3e44-4283-42f3-a65d-e5a9b3dcf88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.243064 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa3e44-4283-42f3-a65d-e5a9b3dcf88d admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.243551 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa3e44-4283-42f3-a65d-e5a9b3dcf88d admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.243893 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa3e44-4283-42f3-a65d-e5a9b3dcf88d admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.244619 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa3e44-4283-42f3-a65d-e5a9b3dcf88d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.246826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa3e44-4283-42f3-a65d-e5a9b3dcf88d admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.277529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1445/2886] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 10:06:54 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:06:54.282696 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6dc7-7134-449c-a662-a8b55e307553 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.297732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b6dc7-7134-449c-a662-a8b55e307553 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.302978 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf62298-7954-480f-b701-2ea5819bdde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.303593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62298-7954-480f-b701-2ea5819bdde4 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.303875 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62298-7954-480f-b701-2ea5819bdde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.304151 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf62298-7954-480f-b701-2ea5819bdde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.304825 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf62298-7954-480f-b701-2ea5819bdde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.306569 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf62298-7954-480f-b701-2ea5819bdde4 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.318896 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1442/2887] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:06:54.323273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa3e44-4283-42f3-a65d-e5a9b3dcf88d admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.335155 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa3e44-4283-42f3-a65d-e5a9b3dcf88d admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.339851 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015ed565-34b6-416e-b5f0-15dea6725dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.340493 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed565-34b6-416e-b5f0-15dea6725dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.340773 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed565-34b6-416e-b5f0-15dea6725dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.341046 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015ed565-34b6-416e-b5f0-15dea6725dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.341690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ed565-34b6-416e-b5f0-15dea6725dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.343941 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015ed565-34b6-416e-b5f0-15dea6725dd2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.355079 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1446/2888] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:06:54.359493 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf62298-7954-480f-b701-2ea5819bdde4 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.369649 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf62298-7954-480f-b701-2ea5819bdde4 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.374333 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7a059-3b12-41cc-b599-7c741da8ccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.374972 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7a059-3b12-41cc-b599-7c741da8ccb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.375251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7a059-3b12-41cc-b599-7c741da8ccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.375524 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7a059-3b12-41cc-b599-7c741da8ccb8 admin admin] PATH_INFO: `/v3/projects/caec40066bf544d7bac2acd4fbd8e928/users/f853df40fede4eb49899528d8032feb7/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.391587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7a059-3b12-41cc-b599-7c741da8ccb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caec40066bf544d7bac2acd4fbd8e928, user_id=f853df40fede4eb49899528d8032feb7, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.394207 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7a059-3b12-41cc-b599-7c741da8ccb8 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.408010 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1443/2889] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:06:54 2022] PUT /identity/v3/projects/caec40066bf544d7bac2acd4fbd8e928/users/f853df40fede4eb49899528d8032feb7/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:06:54.418646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48eab6-5d21-4b2c-a3f4-9cc1ea55753a None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.418932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48eab6-5d21-4b2c-a3f4-9cc1ea55753a None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.419304 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48eab6-5d21-4b2c-a3f4-9cc1ea55753a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.449434 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6c48eab6-5d21-4b2c-a3f4-9cc1ea55753a None None] MFA Rules not processed for user `f853df40fede4eb49899528d8032feb7`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:06:54.451421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6c48eab6-5d21-4b2c-a3f4-9cc1ea55753a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:54.524610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1447/2890] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:06:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:06:54.529187 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7a059-3b12-41cc-b599-7c741da8ccb8 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.599812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7a059-3b12-41cc-b599-7c741da8ccb8 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.604703 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d5bd2-dc31-4d84-b9b3-dff34151d7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.605306 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5bd2-dc31-4d84-b9b3-dff34151d7fe admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.605587 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5bd2-dc31-4d84-b9b3-dff34151d7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.605857 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d5bd2-dc31-4d84-b9b3-dff34151d7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.606500 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d5bd2-dc31-4d84-b9b3-dff34151d7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.608757 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d5bd2-dc31-4d84-b9b3-dff34151d7fe admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.613624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:54.641150 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1444/2891] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 10:06:54 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:06:54.646725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48eab6-5d21-4b2c-a3f4-9cc1ea55753a None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.660485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c48eab6-5d21-4b2c-a3f4-9cc1ea55753a None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.739056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae9d86-472b-4d2f-9de9-830555d8d323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.739721 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9d86-472b-4d2f-9de9-830555d8d323 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.740005 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9d86-472b-4d2f-9de9-830555d8d323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.740312 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae9d86-472b-4d2f-9de9-830555d8d323 admin admin] PATH_INFO: `/v3/users` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.741007 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae9d86-472b-4d2f-9de9-830555d8d323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.742978 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae9d86-472b-4d2f-9de9-830555d8d323 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.770473 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1448/2892] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 10:06:54 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:06:54.775205 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d5bd2-dc31-4d84-b9b3-dff34151d7fe admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.786699 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d5bd2-dc31-4d84-b9b3-dff34151d7fe admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.791835 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e390079-f9b3-4e5f-b78b-c5a5a0c2bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.792686 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e390079-f9b3-4e5f-b78b-c5a5a0c2bd2a admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.793074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e390079-f9b3-4e5f-b78b-c5a5a0c2bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.793358 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e390079-f9b3-4e5f-b78b-c5a5a0c2bd2a admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.794016 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e390079-f9b3-4e5f-b78b-c5a5a0c2bd2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.795805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e390079-f9b3-4e5f-b78b-c5a5a0c2bd2a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.807734 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1445/2893] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:06:54.813690 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae9d86-472b-4d2f-9de9-830555d8d323 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.830900 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae9d86-472b-4d2f-9de9-830555d8d323 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.835897 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ef39-fcff-4c0e-971c-cc3bb32fa7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.836601 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ef39-fcff-4c0e-971c-cc3bb32fa7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.836888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ef39-fcff-4c0e-971c-cc3bb32fa7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.837171 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0258ef39-fcff-4c0e-971c-cc3bb32fa7dd admin admin] PATH_INFO: `/v3/projects/129f69b0d804407db02f4ece7936a1af/users/0d2140b50f5d4b489fcee28328b1a142/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.854268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258ef39-fcff-4c0e-971c-cc3bb32fa7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=129f69b0d804407db02f4ece7936a1af, user_id=0d2140b50f5d4b489fcee28328b1a142, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.857097 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0258ef39-fcff-4c0e-971c-cc3bb32fa7dd admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.875555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1449/2894] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:06:54 2022] PUT /identity/v3/projects/129f69b0d804407db02f4ece7936a1af/users/0d2140b50f5d4b489fcee28328b1a142/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:06:54.880141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e390079-f9b3-4e5f-b78b-c5a5a0c2bd2a admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.891245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e390079-f9b3-4e5f-b78b-c5a5a0c2bd2a admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.952220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f233f84-5881-492d-8113-66141b1c1934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.953647 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233f84-5881-492d-8113-66141b1c1934 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.953983 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233f84-5881-492d-8113-66141b1c1934 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.954255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f233f84-5881-492d-8113-66141b1c1934 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.954916 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f233f84-5881-492d-8113-66141b1c1934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:54.956591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f233f84-5881-492d-8113-66141b1c1934 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:54.967811 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1446/2895] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:06:54.973256 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ef39-fcff-4c0e-971c-cc3bb32fa7dd admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:54.988525 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0258ef39-fcff-4c0e-971c-cc3bb32fa7dd admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:54.994172 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:54.994930 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:54.995214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:54.995533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] PATH_INFO: `/v3/projects/129f69b0d804407db02f4ece7936a1af/users/0d2140b50f5d4b489fcee28328b1a142/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:54.997627 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=129f69b0d804407db02f4ece7936a1af, user_id=0d2140b50f5d4b489fcee28328b1a142, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:55.001190 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:55.013889 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1450/2896] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:06:54 2022] PUT /identity/v3/projects/129f69b0d804407db02f4ece7936a1af/users/0d2140b50f5d4b489fcee28328b1a142/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:06:55.024745 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722083c2-7f35-48b4-9020-518eaf8be7ee None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:55.025111 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722083c2-7f35-48b4-9020-518eaf8be7ee None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:55.025400 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722083c2-7f35-48b4-9020-518eaf8be7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:55.058485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-722083c2-7f35-48b4-9020-518eaf8be7ee None None] MFA Rules not processed for user `0d2140b50f5d4b489fcee28328b1a142`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:06:55.059764 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-722083c2-7f35-48b4-9020-518eaf8be7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:55.151221 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1447/2897] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:06:55 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:06:55.162800 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:55.164594 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:55.184712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:55.228314 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dabd8-57fe-4223-b35d-a17701809f9f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:55.231890 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3daff-e47f-4327-93aa-16119c7cdbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:55.232524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3daff-e47f-4327-93aa-16119c7cdbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:55.232802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3daff-e47f-4327-93aa-16119c7cdbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:55.233071 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3daff-e47f-4327-93aa-16119c7cdbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:55.242533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3daff-e47f-4327-93aa-16119c7cdbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:55.243969 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3daff-e47f-4327-93aa-16119c7cdbf7 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:55.253744 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1451/2898] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:06:55 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:06:55.785190 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722083c2-7f35-48b4-9020-518eaf8be7ee None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:55.786582 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-722083c2-7f35-48b4-9020-518eaf8be7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:06:55.799812 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722083c2-7f35-48b4-9020-518eaf8be7ee None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:55.803449 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba4e8c-1eab-470c-86ee-33e459405eae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:55.804041 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4e8c-1eab-470c-86ee-33e459405eae service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:55.804349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4e8c-1eab-470c-86ee-33e459405eae service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:55.804620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba4e8c-1eab-470c-86ee-33e459405eae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:06:55.865108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:06:55.870503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba4e8c-1eab-470c-86ee-33e459405eae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:06:55.872271 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba4e8c-1eab-470c-86ee-33e459405eae service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:06:55.882371 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1448/2899] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:06:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:06:59.974464 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3daff-e47f-4327-93aa-16119c7cdbf7 service cinder] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:06:59.985122 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3daff-e47f-4327-93aa-16119c7cdbf7 service cinder] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:06:59.988818 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ae207-bc94-4cfd-b118-390fe158dda3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:06:59.989411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae207-bc94-4cfd-b118-390fe158dda3 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:06:59.989687 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae207-bc94-4cfd-b118-390fe158dda3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:06:59.989957 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ae207-bc94-4cfd-b118-390fe158dda3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:00.048906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ae207-bc94-4cfd-b118-390fe158dda3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:00.050341 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ae207-bc94-4cfd-b118-390fe158dda3 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:00.059735 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1452/2900] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:06:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:07:02.240859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba4e8c-1eab-470c-86ee-33e459405eae service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:02.318336 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba4e8c-1eab-470c-86ee-33e459405eae service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:02.322878 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:02.323544 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:02.323824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:02.324094 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] PATH_INFO: `/v3/users/b2c070474e2241e482d7bf0cce274ef9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:02.325434 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c070474e2241e482d7bf0cce274ef9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:02.327514 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:02.383186 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c070474e2241e482d7bf0cce274ef9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:02.383879 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c070474e2241e482d7bf0cce274ef9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:02.392330 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c070474e2241e482d7bf0cce274ef9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:02.404543 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c070474e2241e482d7bf0cce274ef9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:02.411861 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c070474e2241e482d7bf0cce274ef9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:02.417927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1449/2901] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 10:07:02 2022] DELETE /identity/v3/users/b2c070474e2241e482d7bf0cce274ef9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:02.422844 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256de4d-29a8-4a77-9fda-af4828db60f7 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:02.423366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256de4d-29a8-4a77-9fda-af4828db60f7 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:02.423485 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f256de4d-29a8-4a77-9fda-af4828db60f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:02.445411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-f256de4d-29a8-4a77-9fda-af4828db60f7 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:02.446843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f256de4d-29a8-4a77-9fda-af4828db60f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:02.527646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1453/2902] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:02.538784 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:02.540384 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:02.634864 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f6983-66e8-434a-b10f-f039f4fb73bc admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:02.638591 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061ca1a-55d4-4eda-ac7c-a2c627dc27c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:02.639203 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061ca1a-55d4-4eda-ac7c-a2c627dc27c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:02.639485 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061ca1a-55d4-4eda-ac7c-a2c627dc27c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:02.639765 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061ca1a-55d4-4eda-ac7c-a2c627dc27c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:02.649565 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061ca1a-55d4-4eda-ac7c-a2c627dc27c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:02.651032 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061ca1a-55d4-4eda-ac7c-a2c627dc27c4 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:02.661403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1450/2903] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:07:02.943468 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256de4d-29a8-4a77-9fda-af4828db60f7 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:02.945061 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-f256de4d-29a8-4a77-9fda-af4828db60f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:02.960456 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f256de4d-29a8-4a77-9fda-af4828db60f7 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:02.965233 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:02.966482 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:02.966961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:02.967238 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] PATH_INFO: `/v3/projects/082c08f165694516bf95d86426707331` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:02.968446 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082c08f165694516bf95d86426707331)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:02.971164 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:03.020596 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082c08f165694516bf95d86426707331', 'request_id': 'req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.023269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:03.030716 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082c08f165694516bf95d86426707331', 'request_id': 'req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.040037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082c08f165694516bf95d86426707331', 'request_id': 'req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.052671 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] The token cache is being invalidate because project 082c08f165694516bf95d86426707331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:07:03.052983 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.053948 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.055532 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1454/2904] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 10:07:02 2022] DELETE /identity/v3/projects/082c08f165694516bf95d86426707331 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:03.060103 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061ca1a-55d4-4eda-ac7c-a2c627dc27c4 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:03.066848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:03.070748 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061ca1a-55d4-4eda-ac7c-a2c627dc27c4 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:03.132562 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:03.133191 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:03.133465 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:03.133732 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] PATH_INFO: `/v3/users/f853df40fede4eb49899528d8032feb7` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:03.134866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=f853df40fede4eb49899528d8032feb7)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:03.136841 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:03.186293 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f853df40fede4eb49899528d8032feb7'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.187013 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f853df40fede4eb49899528d8032feb7'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.196036 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f853df40fede4eb49899528d8032feb7'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.208882 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f853df40fede4eb49899528d8032feb7'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.216395 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f853df40fede4eb49899528d8032feb7'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.223622 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1451/2905] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 10:07:03 2022] DELETE /identity/v3/users/f853df40fede4eb49899528d8032feb7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:03.526310 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:03.527809 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:03.542518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a5532-1cb4-41b3-81b7-fcd4d34b6b27 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:03.626879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:03.627513 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:03.627790 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:03.628056 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] PATH_INFO: `/v3/projects/caec40066bf544d7bac2acd4fbd8e928` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:03.629237 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caec40066bf544d7bac2acd4fbd8e928)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:03.631160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:03.681502 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caec40066bf544d7bac2acd4fbd8e928', 'request_id': 'req-025e120b-7cb4-47ba-8605-7a2a923ec279'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.690273 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caec40066bf544d7bac2acd4fbd8e928', 'request_id': 'req-025e120b-7cb4-47ba-8605-7a2a923ec279'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.697269 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caec40066bf544d7bac2acd4fbd8e928', 'request_id': 'req-025e120b-7cb4-47ba-8605-7a2a923ec279'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.708478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] The token cache is being invalidate because project caec40066bf544d7bac2acd4fbd8e928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:07:03.708843 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.709414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.710917 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1455/2906] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 10:07:03 2022] DELETE /identity/v3/projects/caec40066bf544d7bac2acd4fbd8e928 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:03.715130 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:03.716654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:03.730507 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07167336-2df4-4b4b-93b8-7aa320de8ada admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:03.790095 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:03.790730 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:03.791007 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:03.791280 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] PATH_INFO: `/v3/users/0d2140b50f5d4b489fcee28328b1a142` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:03.792441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d2140b50f5d4b489fcee28328b1a142)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:03.794387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:03.822937 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:03.845630 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2140b50f5d4b489fcee28328b1a142'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.846279 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2140b50f5d4b489fcee28328b1a142'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.853805 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2140b50f5d4b489fcee28328b1a142'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.866515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2140b50f5d4b489fcee28328b1a142'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.873445 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-2e76f90f-05af-405a-bbe7-9fdd74d2dc01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2140b50f5d4b489fcee28328b1a142'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:03.880295 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1452/2907] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 10:07:03 2022] DELETE /identity/v3/users/0d2140b50f5d4b489fcee28328b1a142 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:04.167586 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:04.169065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:04.185448 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e120b-7cb4-47ba-8605-7a2a923ec279 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:04.246486 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:04.247033 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.247319 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.247626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] PATH_INFO: `/v3/projects/129f69b0d804407db02f4ece7936a1af` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.248801 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] RBAC: Authorizing `identity:delete_project(project_id=129f69b0d804407db02f4ece7936a1af)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:04.251981 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:04.264826 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:04.304478 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129f69b0d804407db02f4ece7936a1af', 'request_id': 'req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:04.312145 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129f69b0d804407db02f4ece7936a1af', 'request_id': 'req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:04.319831 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129f69b0d804407db02f4ece7936a1af', 'request_id': 'req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:04.330511 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] The token cache is being invalidate because project 129f69b0d804407db02f4ece7936a1af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:07:04.330797 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:04.331458 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-9aea9c3e-feed-4d43-a1b0-d9e15e0d804f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:04.333037 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1456/2908] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 10:07:04 2022] DELETE /identity/v3/projects/129f69b0d804407db02f4ece7936a1af => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:04.339155 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4750d-bea4-467e-ad46-1b8cdb7efd06 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.339441 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4750d-bea4-467e-ad46-1b8cdb7efd06 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.339724 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4750d-bea4-467e-ad46-1b8cdb7efd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.364976 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-abf4750d-bea4-467e-ad46-1b8cdb7efd06 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:04.366220 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-abf4750d-bea4-467e-ad46-1b8cdb7efd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:04.431075 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1453/2909] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:07:04.440426 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bcb9-8e5c-458e-ad30-b96562189aa6 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.440715 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bcb9-8e5c-458e-ad30-b96562189aa6 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.440990 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944bcb9-8e5c-458e-ad30-b96562189aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.462313 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-7944bcb9-8e5c-458e-ad30-b96562189aa6 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:04.463583 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-7944bcb9-8e5c-458e-ad30-b96562189aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:04.472110 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1457/2910] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:04.476510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4750d-bea4-467e-ad46-1b8cdb7efd06 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:04.487379 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4750d-bea4-467e-ad46-1b8cdb7efd06 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:04.492099 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:04.492743 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.493028 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.493303 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.493964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:07:04.494268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:04.495895 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:04.509005 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1454/2911] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 10:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:07:04.513320 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944bcb9-8e5c-458e-ad30-b96562189aa6 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:04.523847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944bcb9-8e5c-458e-ad30-b96562189aa6 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:04.528674 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b0dee-2697-424a-a3bd-242ea23af47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:04.529299 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0dee-2697-424a-a3bd-242ea23af47e admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.529582 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0dee-2697-424a-a3bd-242ea23af47e admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.529854 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b0dee-2697-424a-a3bd-242ea23af47e admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.530510 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b0dee-2697-424a-a3bd-242ea23af47e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:04.532835 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b0dee-2697-424a-a3bd-242ea23af47e admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:04.562027 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1458/2912] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 10:07:04 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:07:04.566624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:04.576824 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a37440-b586-4069-80cf-9be25a17a466 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:04.637854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dea869-5fd2-4f96-b99b-26b3229dca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:04.638463 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea869-5fd2-4f96-b99b-26b3229dca79 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.638742 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea869-5fd2-4f96-b99b-26b3229dca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.639015 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea869-5fd2-4f96-b99b-26b3229dca79 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.639664 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dea869-5fd2-4f96-b99b-26b3229dca79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:04.642681 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dea869-5fd2-4f96-b99b-26b3229dca79 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:04.665382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1455/2913] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 10:07:04 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:07:04.669417 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b0dee-2697-424a-a3bd-242ea23af47e admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:04.681062 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b0dee-2697-424a-a3bd-242ea23af47e admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:04.687065 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222ea7b-a9b7-4e85-9e2b-7d78cbb953f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:04.688676 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ea7b-a9b7-4e85-9e2b-7d78cbb953f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.688961 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ea7b-a9b7-4e85-9e2b-7d78cbb953f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.689234 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222ea7b-a9b7-4e85-9e2b-7d78cbb953f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.691592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222ea7b-a9b7-4e85-9e2b-7d78cbb953f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:04.693252 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222ea7b-a9b7-4e85-9e2b-7d78cbb953f9 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:04.705002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1459/2914] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:07:04.709148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dea869-5fd2-4f96-b99b-26b3229dca79 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:04.719888 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dea869-5fd2-4f96-b99b-26b3229dca79 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:04.724750 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5b291-95f7-4b38-8b6e-d89f851889ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:04.725368 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b291-95f7-4b38-8b6e-d89f851889ca admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.725651 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b291-95f7-4b38-8b6e-d89f851889ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.725926 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5b291-95f7-4b38-8b6e-d89f851889ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.726576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b291-95f7-4b38-8b6e-d89f851889ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:04.728219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5b291-95f7-4b38-8b6e-d89f851889ca admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:04.740269 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1456/2915] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:07:04.744507 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222ea7b-a9b7-4e85-9e2b-7d78cbb953f9 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:04.755353 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222ea7b-a9b7-4e85-9e2b-7d78cbb953f9 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:04.760112 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c6a72-bc7a-4247-99e6-3e491bee71d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:04.760750 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6a72-bc7a-4247-99e6-3e491bee71d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.761029 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6a72-bc7a-4247-99e6-3e491bee71d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.761305 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c6a72-bc7a-4247-99e6-3e491bee71d2 admin admin] PATH_INFO: `/v3/projects/3f2e26d0838449d3989d22dc2d9e3cd6/users/b2627affda294f4ea24b9120631d70bb/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.776717 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c6a72-bc7a-4247-99e6-3e491bee71d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2e26d0838449d3989d22dc2d9e3cd6, user_id=b2627affda294f4ea24b9120631d70bb, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:04.779411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c6a72-bc7a-4247-99e6-3e491bee71d2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:04.792932 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1460/2916] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:07:04 2022] PUT /identity/v3/projects/3f2e26d0838449d3989d22dc2d9e3cd6/users/b2627affda294f4ea24b9120631d70bb/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:04.805118 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92b015-14c6-45cb-ba82-0889ee535f69 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.805403 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92b015-14c6-45cb-ba82-0889ee535f69 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.805678 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92b015-14c6-45cb-ba82-0889ee535f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.826253 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:04.838794 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-9b92b015-14c6-45cb-ba82-0889ee535f69 None None] MFA Rules not processed for user `b2627affda294f4ea24b9120631d70bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:04.840713 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-9b92b015-14c6-45cb-ba82-0889ee535f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:04.913656 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1457/2917] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:04.918403 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c6a72-bc7a-4247-99e6-3e491bee71d2 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:04.985599 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c6a72-bc7a-4247-99e6-3e491bee71d2 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:04.990388 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b44cc-acdf-4d4d-960d-49cd1e49920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:04.991002 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b44cc-acdf-4d4d-960d-49cd1e49920f admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:04.991283 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b44cc-acdf-4d4d-960d-49cd1e49920f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:04.991555 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b44cc-acdf-4d4d-960d-49cd1e49920f admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:04.992228 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b44cc-acdf-4d4d-960d-49cd1e49920f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:04.994154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b44cc-acdf-4d4d-960d-49cd1e49920f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:05.023168 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1461/2918] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 10:07:04 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:07:05.028074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92b015-14c6-45cb-ba82-0889ee535f69 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:05.042119 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92b015-14c6-45cb-ba82-0889ee535f69 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:05.118390 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdeedb-ac2d-49e4-945a-927f8cb1a4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:05.119011 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdeedb-ac2d-49e4-945a-927f8cb1a4ac admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:05.119299 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdeedb-ac2d-49e4-945a-927f8cb1a4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:05.119577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cdeedb-ac2d-49e4-945a-927f8cb1a4ac admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:05.120251 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdeedb-ac2d-49e4-945a-927f8cb1a4ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:05.122225 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cdeedb-ac2d-49e4-945a-927f8cb1a4ac admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:05.146486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1458/2919] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 10:07:05 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:07:05.150593 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b44cc-acdf-4d4d-960d-49cd1e49920f admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:05.163537 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b44cc-acdf-4d4d-960d-49cd1e49920f admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:05.169043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533e286-989a-4f97-8e85-ba4a3eaa27a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:05.169660 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533e286-989a-4f97-8e85-ba4a3eaa27a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:05.169939 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533e286-989a-4f97-8e85-ba4a3eaa27a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:05.170210 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533e286-989a-4f97-8e85-ba4a3eaa27a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:05.170864 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533e286-989a-4f97-8e85-ba4a3eaa27a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:05.173159 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5533e286-989a-4f97-8e85-ba4a3eaa27a4 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:05.185433 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1462/2920] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:07:05.190444 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdeedb-ac2d-49e4-945a-927f8cb1a4ac admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:05.202298 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cdeedb-ac2d-49e4-945a-927f8cb1a4ac admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:05.207637 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc3be2-eb4a-45ee-8cc9-e69ab1c14966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:05.208347 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc3be2-eb4a-45ee-8cc9-e69ab1c14966 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:05.208670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc3be2-eb4a-45ee-8cc9-e69ab1c14966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:05.208903 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc3be2-eb4a-45ee-8cc9-e69ab1c14966 admin admin] PATH_INFO: `/v3/projects/4ffb278eb29d4787bf21617b921a43f1/users/d0041d39f3e3416aae12fd873987b18d/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:05.227245 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc3be2-eb4a-45ee-8cc9-e69ab1c14966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffb278eb29d4787bf21617b921a43f1, user_id=d0041d39f3e3416aae12fd873987b18d, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:05.229995 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc3be2-eb4a-45ee-8cc9-e69ab1c14966 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:05.247712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1459/2921] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:07:05 2022] PUT /identity/v3/projects/4ffb278eb29d4787bf21617b921a43f1/users/d0041d39f3e3416aae12fd873987b18d/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:05.252838 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533e286-989a-4f97-8e85-ba4a3eaa27a4 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:05.267634 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533e286-989a-4f97-8e85-ba4a3eaa27a4 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:05.277294 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:05.340147 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4adf594-a16a-45ea-a3df-e9620d09a47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:05.340812 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf594-a16a-45ea-a3df-e9620d09a47b admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:05.341102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf594-a16a-45ea-a3df-e9620d09a47b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:05.341501 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4adf594-a16a-45ea-a3df-e9620d09a47b admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:05.342177 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adf594-a16a-45ea-a3df-e9620d09a47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:05.344592 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4adf594-a16a-45ea-a3df-e9620d09a47b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:05.356847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1463/2922] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:07:05.361860 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc3be2-eb4a-45ee-8cc9-e69ab1c14966 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:05.372837 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc3be2-eb4a-45ee-8cc9-e69ab1c14966 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:05.378264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:05.378934 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:05.379218 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:05.379480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] PATH_INFO: `/v3/projects/4ffb278eb29d4787bf21617b921a43f1/users/d0041d39f3e3416aae12fd873987b18d/roles/efaaf0cd59694f50947c6a026ec9fdbf` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:05.381496 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffb278eb29d4787bf21617b921a43f1, user_id=d0041d39f3e3416aae12fd873987b18d, role_id=efaaf0cd59694f50947c6a026ec9fdbf)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:05.384254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:05.396460 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1460/2923] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:07:05 2022] PUT /identity/v3/projects/4ffb278eb29d4787bf21617b921a43f1/users/d0041d39f3e3416aae12fd873987b18d/roles/efaaf0cd59694f50947c6a026ec9fdbf => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:05.410204 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b6e1-b511-4cb8-ada2-d9e864d0ba65 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:05.410491 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b6e1-b511-4cb8-ada2-d9e864d0ba65 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:05.410770 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28b6e1-b511-4cb8-ada2-d9e864d0ba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:05.442120 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-6f28b6e1-b511-4cb8-ada2-d9e864d0ba65 None None] MFA Rules not processed for user `d0041d39f3e3416aae12fd873987b18d`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:05.443368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6f28b6e1-b511-4cb8-ada2-d9e864d0ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:05.520295 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1464/2924] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:05.531284 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:05.533126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:05.599608 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d65f4-c789-41e7-99aa-be8442d376b9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:05.603589 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312bbc2-7538-4286-bdce-ea72b803bdc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:05.606230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312bbc2-7538-4286-bdce-ea72b803bdc2 service cinder] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:05.606230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312bbc2-7538-4286-bdce-ea72b803bdc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:05.606230 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312bbc2-7538-4286-bdce-ea72b803bdc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:05.610252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:05.669387 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312bbc2-7538-4286-bdce-ea72b803bdc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:05.671152 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312bbc2-7538-4286-bdce-ea72b803bdc2 service cinder] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:05.681626 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1461/2925] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:07:05 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:07:09.995559 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28b6e1-b511-4cb8-ada2-d9e864d0ba65 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:09.997134 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-6f28b6e1-b511-4cb8-ada2-d9e864d0ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:10.009699 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28b6e1-b511-4cb8-ada2-d9e864d0ba65 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:10.013224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f62593-4c12-4327-9fdc-dcdd20fbb14a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:10.013822 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f62593-4c12-4327-9fdc-dcdd20fbb14a service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:10.014101 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f62593-4c12-4327-9fdc-dcdd20fbb14a service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:10.014368 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f62593-4c12-4327-9fdc-dcdd20fbb14a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:10.023529 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f62593-4c12-4327-9fdc-dcdd20fbb14a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:10.024959 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f62593-4c12-4327-9fdc-dcdd20fbb14a service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:10.035865 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1465/2926] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:07:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:07:14.949427 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312bbc2-7538-4286-bdce-ea72b803bdc2 service cinder] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:15.012906 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312bbc2-7538-4286-bdce-ea72b803bdc2 service cinder] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:15.018018 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:15.018641 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:15.018922 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:15.019199 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] PATH_INFO: `/v3/users/b2627affda294f4ea24b9120631d70bb` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:15.020361 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2627affda294f4ea24b9120631d70bb)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:15.022307 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:15.070511 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2627affda294f4ea24b9120631d70bb'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.071167 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2627affda294f4ea24b9120631d70bb'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.081831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2627affda294f4ea24b9120631d70bb'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.095480 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2627affda294f4ea24b9120631d70bb'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.102246 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2627affda294f4ea24b9120631d70bb'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.108074 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1462/2927] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 10:07:14 2022] DELETE /identity/v3/users/b2627affda294f4ea24b9120631d70bb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:15.112704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390fa3a-61b4-4096-a6f8-632508cebaa0 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:15.113235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390fa3a-61b4-4096-a6f8-632508cebaa0 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:15.113235 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0390fa3a-61b4-4096-a6f8-632508cebaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:15.132533 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-0390fa3a-61b4-4096-a6f8-632508cebaa0 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:15.133729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0390fa3a-61b4-4096-a6f8-632508cebaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:15.194859 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1466/2928] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:15.205092 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:15.206477 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:15.233907 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:15.265583 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea98bd0c-65a7-4de8-859b-9bf3e2660560 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:15.269252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1b616-e8a9-43ac-979e-1dfe4c738eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:15.269858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b616-e8a9-43ac-979e-1dfe4c738eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:15.270139 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b616-e8a9-43ac-979e-1dfe4c738eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:15.270413 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1b616-e8a9-43ac-979e-1dfe4c738eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:15.279423 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1b616-e8a9-43ac-979e-1dfe4c738eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:15.280911 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1b616-e8a9-43ac-979e-1dfe4c738eb4 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:15.290712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1463/2929] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:07:15.558414 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390fa3a-61b4-4096-a6f8-632508cebaa0 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:15.559839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-0390fa3a-61b4-4096-a6f8-632508cebaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:15.572518 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0390fa3a-61b4-4096-a6f8-632508cebaa0 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:15.577346 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:15.577977 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:15.578254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:15.578524 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] PATH_INFO: `/v3/projects/3f2e26d0838449d3989d22dc2d9e3cd6` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:15.579675 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2e26d0838449d3989d22dc2d9e3cd6)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:15.581606 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:15.598916 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=100 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:15.629196 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2e26d0838449d3989d22dc2d9e3cd6', 'request_id': 'req-513db2c2-8395-4463-85b4-1ae1a9e9437b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.636858 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2e26d0838449d3989d22dc2d9e3cd6', 'request_id': 'req-513db2c2-8395-4463-85b4-1ae1a9e9437b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.643725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2e26d0838449d3989d22dc2d9e3cd6', 'request_id': 'req-513db2c2-8395-4463-85b4-1ae1a9e9437b'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.654614 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] The token cache is being invalidate because project 3f2e26d0838449d3989d22dc2d9e3cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:07:15.654903 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.655557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.657774 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1467/2930] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 10:07:15 2022] DELETE /identity/v3/projects/3f2e26d0838449d3989d22dc2d9e3cd6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:15.662382 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1b616-e8a9-43ac-979e-1dfe4c738eb4 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:15.672523 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1b616-e8a9-43ac-979e-1dfe4c738eb4 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:15.732362 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:15.733000 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:15.733275 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:15.733547 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] PATH_INFO: `/v3/users/d0041d39f3e3416aae12fd873987b18d` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:15.734695 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0041d39f3e3416aae12fd873987b18d)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:15.737268 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:15.787576 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0041d39f3e3416aae12fd873987b18d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.788277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0041d39f3e3416aae12fd873987b18d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.797367 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0041d39f3e3416aae12fd873987b18d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.810992 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0041d39f3e3416aae12fd873987b18d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.818318 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-a9de3d51-3d3e-4baa-87a7-a87457b4f46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0041d39f3e3416aae12fd873987b18d'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:15.824577 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1464/2931] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 10:07:15 2022] DELETE /identity/v3/users/d0041d39f3e3416aae12fd873987b18d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:16.109568 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:16.111226 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:16.125988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513db2c2-8395-4463-85b4-1ae1a9e9437b admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:16.183342 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:16.183974 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.184282 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.184557 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] PATH_INFO: `/v3/projects/4ffb278eb29d4787bf21617b921a43f1` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.185672 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffb278eb29d4787bf21617b921a43f1)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:16.187578 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:16.233527 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffb278eb29d4787bf21617b921a43f1', 'request_id': 'req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:16.241028 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffb278eb29d4787bf21617b921a43f1', 'request_id': 'req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:16.247366 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffb278eb29d4787bf21617b921a43f1', 'request_id': 'req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:16.257382 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] The token cache is being invalidate because project 4ffb278eb29d4787bf21617b921a43f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:07:16.257646 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:16.258367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-cf0a0d9b-9ae7-4a9f-a8ff-35058e20ed7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:16.259847 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1468/2932] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 10:07:16 2022] DELETE /identity/v3/projects/4ffb278eb29d4787bf21617b921a43f1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:16.267816 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8b3e2-861b-4166-a200-ef037f74f7fd None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.268321 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8b3e2-861b-4166-a200-ef037f74f7fd None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.268421 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8b3e2-861b-4166-a200-ef037f74f7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.288688 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-49f8b3e2-861b-4166-a200-ef037f74f7fd None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:16.289893 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-49f8b3e2-861b-4166-a200-ef037f74f7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:16.336588 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:16.355517 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1465/2933] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:16.364423 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1e85e-ad8e-4abc-a0d9-6e88b8d0bb1b None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.364711 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1e85e-ad8e-4abc-a0d9-6e88b8d0bb1b None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.365242 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1e85e-ad8e-4abc-a0d9-6e88b8d0bb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.386114 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-79f1e85e-ad8e-4abc-a0d9-6e88b8d0bb1b None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:16.387345 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-79f1e85e-ad8e-4abc-a0d9-6e88b8d0bb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:16.395931 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1469/2934] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:16.400486 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8b3e2-861b-4166-a200-ef037f74f7fd None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:16.411624 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8b3e2-861b-4166-a200-ef037f74f7fd None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:16.416350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:16.416961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.417242 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.417515 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.418554 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:07:16.418859 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:16.420503 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:16.433401 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1466/2935] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 10:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:07:16.437902 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1e85e-ad8e-4abc-a0d9-6e88b8d0bb1b None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:16.447879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1e85e-ad8e-4abc-a0d9-6e88b8d0bb1b None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:16.455148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa040a-5904-4bce-9eab-3bd5eec573de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:16.455148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa040a-5904-4bce-9eab-3bd5eec573de admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.455148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa040a-5904-4bce-9eab-3bd5eec573de admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.455148 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa040a-5904-4bce-9eab-3bd5eec573de admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.456026 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa040a-5904-4bce-9eab-3bd5eec573de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:16.457044 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa040a-5904-4bce-9eab-3bd5eec573de admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:16.484849 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1470/2936] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 10:07:16 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:07:16.489126 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:16.499677 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f36fe1-13aa-4e96-8127-a06cbe0e3ab5 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:16.560108 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cefff-4d73-4368-bcb9-08466f825609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:16.560775 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cefff-4d73-4368-bcb9-08466f825609 admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.561042 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cefff-4d73-4368-bcb9-08466f825609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.561317 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cefff-4d73-4368-bcb9-08466f825609 admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.561964 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cefff-4d73-4368-bcb9-08466f825609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:16.564650 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52cefff-4d73-4368-bcb9-08466f825609 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:16.589101 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1467/2937] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 10:07:16 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:07:16.593445 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa040a-5904-4bce-9eab-3bd5eec573de admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:16.600189 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:16.605657 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa040a-5904-4bce-9eab-3bd5eec573de admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:16.612259 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894cb5-9ec2-459b-be15-cf7e56415b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:16.613138 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894cb5-9ec2-459b-be15-cf7e56415b93 admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.613623 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894cb5-9ec2-459b-be15-cf7e56415b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.614139 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f894cb5-9ec2-459b-be15-cf7e56415b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.614791 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894cb5-9ec2-459b-be15-cf7e56415b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:16.616439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f894cb5-9ec2-459b-be15-cf7e56415b93 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:16.627517 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1471/2938] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:07:16.632854 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cefff-4d73-4368-bcb9-08466f825609 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:16.644109 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52cefff-4d73-4368-bcb9-08466f825609 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:16.649064 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1777f6a-bceb-4525-a2fa-3db2746157cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:16.650025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777f6a-bceb-4525-a2fa-3db2746157cf admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.650025 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777f6a-bceb-4525-a2fa-3db2746157cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.650290 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1777f6a-bceb-4525-a2fa-3db2746157cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.650852 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777f6a-bceb-4525-a2fa-3db2746157cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:16.652548 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1777f6a-bceb-4525-a2fa-3db2746157cf admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:16.664148 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1468/2939] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:07:16.668563 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894cb5-9ec2-459b-be15-cf7e56415b93 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:16.679712 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f894cb5-9ec2-459b-be15-cf7e56415b93 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:16.684509 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:16.685161 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.685441 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.685723 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] PATH_INFO: `/v3/projects/1c16e7a830f64f49b8d4ee69b28d4e5a/users/4d0178901ff84478b0361b5e62fcdba3/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.701498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c16e7a830f64f49b8d4ee69b28d4e5a, user_id=4d0178901ff84478b0361b5e62fcdba3, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:16.704937 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:16.718519 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1472/2940] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:07:16 2022] PUT /identity/v3/projects/1c16e7a830f64f49b8d4ee69b28d4e5a/users/4d0178901ff84478b0361b5e62fcdba3/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:16.730192 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6c137-a34a-4c7c-ab78-cbd9da58c96d None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.730482 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6c137-a34a-4c7c-ab78-cbd9da58c96d None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.730761 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6c137-a34a-4c7c-ab78-cbd9da58c96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.761488 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-b8f6c137-a34a-4c7c-ab78-cbd9da58c96d None None] MFA Rules not processed for user `4d0178901ff84478b0361b5e62fcdba3`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:16.762704 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-b8f6c137-a34a-4c7c-ab78-cbd9da58c96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:16.832712 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1469/2941] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:16.846813 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:16.848579 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:16.905960 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91758-382b-4416-8d9d-010f03216a70 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:16.910701 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212dceb2-4381-4d10-8958-a22d11afa9e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:16.911309 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dceb2-4381-4d10-8958-a22d11afa9e3 service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:16.911590 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dceb2-4381-4d10-8958-a22d11afa9e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:16.911863 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212dceb2-4381-4d10-8958-a22d11afa9e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:16.920347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dceb2-4381-4d10-8958-a22d11afa9e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:16.921771 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212dceb2-4381-4d10-8958-a22d11afa9e3 service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:16.930746 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1473/2942] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:07:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:07:19.503107 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6c137-a34a-4c7c-ab78-cbd9da58c96d None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:19.549654 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:19.569039 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6c137-a34a-4c7c-ab78-cbd9da58c96d None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:19.573623 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:19.574255 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:19.574542 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:19.574821 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] PATH_INFO: `/v3/users/4d0178901ff84478b0361b5e62fcdba3` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:19.575961 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0178901ff84478b0361b5e62fcdba3)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:19.577953 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:19.623655 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0178901ff84478b0361b5e62fcdba3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:19.624411 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0178901ff84478b0361b5e62fcdba3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:19.633258 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0178901ff84478b0361b5e62fcdba3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:19.645727 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0178901ff84478b0361b5e62fcdba3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:19.652344 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0178901ff84478b0361b5e62fcdba3'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:19.658173 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1470/2943] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 10:07:19 2022] DELETE /identity/v3/users/4d0178901ff84478b0361b5e62fcdba3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:19.663224 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327002-6ca2-4a75-8734-a215c2d80419 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:19.663742 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327002-6ca2-4a75-8734-a215c2d80419 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:19.663839 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e327002-6ca2-4a75-8734-a215c2d80419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:19.682603 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-4e327002-6ca2-4a75-8734-a215c2d80419 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:19.683787 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4e327002-6ca2-4a75-8734-a215c2d80419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:19.745907 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1474/2944] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:19.756345 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:19.757779 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:19.815541 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd1b67-ac68-4391-84dd-e538c4d07da9 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:19.819586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa36e4-83b2-452c-8f08-b587f7c74a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:19.820219 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa36e4-83b2-452c-8f08-b587f7c74a20 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:19.820508 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa36e4-83b2-452c-8f08-b587f7c74a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:19.820782 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa36e4-83b2-452c-8f08-b587f7c74a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:19.830391 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa36e4-83b2-452c-8f08-b587f7c74a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:19.831848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa36e4-83b2-452c-8f08-b587f7c74a20 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:19.841549 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1471/2945] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:07:20.109642 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327002-6ca2-4a75-8734-a215c2d80419 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:20.111707 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-4e327002-6ca2-4a75-8734-a215c2d80419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:20.123635 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e327002-6ca2-4a75-8734-a215c2d80419 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:20.129566 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:20.130439 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.130869 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.131315 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] PATH_INFO: `/v3/projects/1c16e7a830f64f49b8d4ee69b28d4e5a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.132785 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c16e7a830f64f49b8d4ee69b28d4e5a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:20.135167 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:20.190574 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c16e7a830f64f49b8d4ee69b28d4e5a', 'request_id': 'req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:20.199626 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c16e7a830f64f49b8d4ee69b28d4e5a', 'request_id': 'req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:20.208039 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c16e7a830f64f49b8d4ee69b28d4e5a', 'request_id': 'req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:20.213500 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:20.222357 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] The token cache is being invalidate because project 1c16e7a830f64f49b8d4ee69b28d4e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:07:20.222906 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:20.223764 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-3b9c03e0-5dde-4243-ae8a-82b0fdb5c2c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:20.225522 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1475/2946] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 10:07:20 2022] DELETE /identity/v3/projects/1c16e7a830f64f49b8d4ee69b28d4e5a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:20.230834 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dbe67-ffab-4130-97d6-1d1950f97fee None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.231121 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dbe67-ffab-4130-97d6-1d1950f97fee None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.231394 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4dbe67-ffab-4130-97d6-1d1950f97fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.252705 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-dd4dbe67-ffab-4130-97d6-1d1950f97fee None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:20.253927 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-dd4dbe67-ffab-4130-97d6-1d1950f97fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:20.319277 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1472/2947] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:07:20.327090 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1b45-7c36-4c92-aca8-6fe42ee92c35 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.327394 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1b45-7c36-4c92-aca8-6fe42ee92c35 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.327669 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed1b45-7c36-4c92-aca8-6fe42ee92c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.348188 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-08ed1b45-7c36-4c92-aca8-6fe42ee92c35 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:20.349397 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-08ed1b45-7c36-4c92-aca8-6fe42ee92c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:20.357411 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1476/2948] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:20.362378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dbe67-ffab-4130-97d6-1d1950f97fee None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:20.368468 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:20.374369 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4dbe67-ffab-4130-97d6-1d1950f97fee None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:20.380814 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:20.381546 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.381866 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.382141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] PATH_INFO: `/v3/domains` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.382797 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88102) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:07:20.383100 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:20.384791 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:20.397350 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1473/2949] 10.222.0.18 () {58 vars in 1153 bytes} [Wed Aug 31 10:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:07:20.401696 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1b45-7c36-4c92-aca8-6fe42ee92c35 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:20.411713 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed1b45-7c36-4c92-aca8-6fe42ee92c35 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:20.416367 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76259c4-ddc2-41e6-8171-952686ed6516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:20.416965 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76259c4-ddc2-41e6-8171-952686ed6516 admin admin] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.417250 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76259c4-ddc2-41e6-8171-952686ed6516 admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.417521 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76259c4-ddc2-41e6-8171-952686ed6516 admin admin] PATH_INFO: `/v3/projects` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.418154 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76259c4-ddc2-41e6-8171-952686ed6516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:20.420041 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76259c4-ddc2-41e6-8171-952686ed6516 admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:20.449654 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1477/2950] 10.222.0.18 () {60 vars in 1153 bytes} [Wed Aug 31 10:07:20 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:07:20.454349 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:20.464254 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432e0f3-bd9f-43bd-b992-443f49d9ca40 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:20.520694 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3012c0-883a-4e58-8bb9-63a2df0fdd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:20.521338 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3012c0-883a-4e58-8bb9-63a2df0fdd3c admin admin] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.521560 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3012c0-883a-4e58-8bb9-63a2df0fdd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.521831 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3012c0-883a-4e58-8bb9-63a2df0fdd3c admin admin] PATH_INFO: `/v3/users` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.522487 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3012c0-883a-4e58-8bb9-63a2df0fdd3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:20.524440 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3012c0-883a-4e58-8bb9-63a2df0fdd3c admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:20.546662 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1474/2951] 10.222.0.18 () {60 vars in 1144 bytes} [Wed Aug 31 10:07:20 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:07:20.551043 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76259c4-ddc2-41e6-8171-952686ed6516 admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:20.561378 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76259c4-ddc2-41e6-8171-952686ed6516 admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:20.566018 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952be7e0-93d3-445f-8bf0-467cfdf4313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:20.566610 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952be7e0-93d3-445f-8bf0-467cfdf4313a admin admin] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.566888 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952be7e0-93d3-445f-8bf0-467cfdf4313a admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.567160 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952be7e0-93d3-445f-8bf0-467cfdf4313a admin admin] PATH_INFO: `/v3/roles` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.567799 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952be7e0-93d3-445f-8bf0-467cfdf4313a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:20.569428 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952be7e0-93d3-445f-8bf0-467cfdf4313a admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:20.579879 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1478/2952] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:07:20.583981 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3012c0-883a-4e58-8bb9-63a2df0fdd3c admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:20.595237 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3012c0-883a-4e58-8bb9-63a2df0fdd3c admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:20.605848 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00d385-4976-46d8-ba7b-cafe4dcd5026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:20.606510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d385-4976-46d8-ba7b-cafe4dcd5026 admin admin] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.606795 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d385-4976-46d8-ba7b-cafe4dcd5026 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.607073 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00d385-4976-46d8-ba7b-cafe4dcd5026 admin admin] PATH_INFO: `/v3/roles` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.607785 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00d385-4976-46d8-ba7b-cafe4dcd5026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:20.609453 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf00d385-4976-46d8-ba7b-cafe4dcd5026 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:20.621183 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1475/2953] 10.222.0.18 () {58 vars in 1122 bytes} [Wed Aug 31 10:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:07:20.625492 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952be7e0-93d3-445f-8bf0-467cfdf4313a admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:20.636763 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952be7e0-93d3-445f-8bf0-467cfdf4313a admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:20.642421 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:20.643214 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.643498 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.643772 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] PATH_INFO: `/v3/projects/5f0154d5b1dc4df9ad19b37dca2f3d45/users/5b7f5eba0e1c4538a7073f7ce95ee0c9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.660086 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0154d5b1dc4df9ad19b37dca2f3d45, user_id=5b7f5eba0e1c4538a7073f7ce95ee0c9, role_id=9e6ef43d2e734ecf9618ade2aab3ec3a)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:20.665802 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:20.682734 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1479/2954] 10.222.0.18 () {60 vars in 1483 bytes} [Wed Aug 31 10:07:20 2022] PUT /identity/v3/projects/5f0154d5b1dc4df9ad19b37dca2f3d45/users/5b7f5eba0e1c4538a7073f7ce95ee0c9/roles/9e6ef43d2e734ecf9618ade2aab3ec3a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:20.693276 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a28661-189b-4553-8f97-0eb85727c775 None None] REQUEST_METHOD: `POST` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.693563 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a28661-189b-4553-8f97-0eb85727c775 None None] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.693829 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a28661-189b-4553-8f97-0eb85727c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.723867 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.auth.core [None req-65a28661-189b-4553-8f97-0eb85727c775 None None] MFA Rules not processed for user `5b7f5eba0e1c4538a7073f7ce95ee0c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88102) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:20.725175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-65a28661-189b-4553-8f97-0eb85727c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:20.791858 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1476/2955] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:07:20.802988 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:20.804704 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:20.866729 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabd573-93cf-4501-b86a-d4602ab777cd admin admin] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:20.870415 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c2a4d-c60d-4a47-abb6-e357986f1d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1aca2564475e4df98d4aef031d0b4302', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:20.871060 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c2a4d-c60d-4a47-abb6-e357986f1d3b service cinder] REQUEST_METHOD: `GET` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:20.871338 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c2a4d-c60d-4a47-abb6-e357986f1d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:20.871613 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c2a4d-c60d-4a47-abb6-e357986f1d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:20.880561 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c2a4d-c60d-4a47-abb6-e357986f1d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:20.882009 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c2a4d-c60d-4a47-abb6-e357986f1d3b service cinder] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:20.891725 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1480/2956] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:07:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:07:30.789141 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:30.887089 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:31.072378 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a28661-189b-4553-8f97-0eb85727c775 None None] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:31.136490 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a28661-189b-4553-8f97-0eb85727c775 None None] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:31.141023 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:31.142504 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:31.142949 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:31.143224 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] PATH_INFO: `/v3/users/5b7f5eba0e1c4538a7073f7ce95ee0c9` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:31.144510 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7f5eba0e1c4538a7073f7ce95ee0c9)` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:31.146439 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:31.194604 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7f5eba0e1c4538a7073f7ce95ee0c9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.195270 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7f5eba0e1c4538a7073f7ce95ee0c9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.202418 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7f5eba0e1c4538a7073f7ce95ee0c9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.215175 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7f5eba0e1c4538a7073f7ce95ee0c9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.222393 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.notifications [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7f5eba0e1c4538a7073f7ce95ee0c9'} {{(pid=88102) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.228264 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1477/2957] 10.222.0.18 () {58 vars in 1224 bytes} [Wed Aug 31 10:07:31 2022] DELETE /identity/v3/users/5b7f5eba0e1c4538a7073f7ce95ee0c9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:31.232980 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f9a5-7c59-483d-8b8c-55f2c73eae30 None None] REQUEST_METHOD: `POST` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:31.233268 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f9a5-7c59-483d-8b8c-55f2c73eae30 None None] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:31.233545 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13f9a5-7c59-483d-8b8c-55f2c73eae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:31.253015 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.auth.core [None req-ae13f9a5-7c59-483d-8b8c-55f2c73eae30 None None] MFA Rules not processed for user `07cf079d1e524f8aa193b1bfe9096586`. Rule list: `[]` (Enabled: `True`). {{(pid=88101) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:07:31.254223 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ae13f9a5-7c59-483d-8b8c-55f2c73eae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:31.317609 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1481/2958] 10.222.0.18 () {58 vars in 958 bytes} [Wed Aug 31 10:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:07:31.328599 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:31.330620 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:31.388788 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f685c21-2a10-445c-a349-ce6498828d39 admin admin] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:31.392771 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '886e718c9d7d48aa8655b8993e2af945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:31.393316 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:31.393593 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:31.393863 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:31.403164 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:31.404685 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:31.415586 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1478/2959] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:07:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:07:31.705919 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13f9a5-7c59-483d-8b8c-55f2c73eae30 None None] Authenticating user token {{(pid=88101) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:07:31.707369 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.fernet_utils [None req-ae13f9a5-7c59-483d-8b8c-55f2c73eae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88101) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:07:31.720231 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13f9a5-7c59-483d-8b8c-55f2c73eae30 None None] Validating token access rules against request {{(pid=88101) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:07:31.725102 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07cf079d1e524f8aa193b1bfe9096586', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7cebf42df3d496db8970830cfea66a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88101) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:07:31.725749 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:07:31.726024 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:07:31.726293 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] PATH_INFO: `/v3/projects/5f0154d5b1dc4df9ad19b37dca2f3d45` {{(pid=88101) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:07:31.727982 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0154d5b1dc4df9ad19b37dca2f3d45)` {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:07:31.729356 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] RBAC: Authorization granted {{(pid=88101) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:07:31.786371 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0154d5b1dc4df9ad19b37dca2f3d45', 'request_id': 'req-352b1da8-b08e-4d5d-ba38-9561008ccf7f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.795861 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0154d5b1dc4df9ad19b37dca2f3d45', 'request_id': 'req-352b1da8-b08e-4d5d-ba38-9561008ccf7f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.803254 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0154d5b1dc4df9ad19b37dca2f3d45', 'request_id': 'req-352b1da8-b08e-4d5d-ba38-9561008ccf7f'} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.814823 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] The token cache is being invalidate because project 5f0154d5b1dc4df9ad19b37dca2f3d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88101) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:07:31.815115 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.815804 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG keystone.notifications [None req-352b1da8-b08e-4d5d-ba38-9561008ccf7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88101) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:07:31.817347 dv-cinder-844961-2-smb devstack@keystone.service[88101]: [pid: 88101|app: 0|req: 1482/2960] 10.222.0.18 () {58 vars in 1233 bytes} [Wed Aug 31 10:07:31 2022] DELETE /identity/v3/projects/5f0154d5b1dc4df9ad19b37dca2f3d45 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:07:41.410304 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:07:41.810705 dv-cinder-844961-2-smb devstack@keystone.service[88101]: DEBUG dbcounter [-] [88101] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88101) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:10:05.953104 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] Authenticating user token {{(pid=88102) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:10:05.955149 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:10:06.042873 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1d93ee-3d3d-4231-9aa9-baad619bd0c6 service neutron] Validating token access rules against request {{(pid=88102) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:10:06.114114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb5dca-0273-47b2-970e-fa4a3570fc9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55fa039431004ca19da7c95ad6f428a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2bf987a0692345ed85d0121efd2c30c6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88102) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:10:06.114114 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5dca-0273-47b2-970e-fa4a3570fc9d service placement] REQUEST_METHOD: `GET` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:10:06.115185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5dca-0273-47b2-970e-fa4a3570fc9d service placement] SCRIPT_NAME: `/identity` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:10:06.115185 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb5dca-0273-47b2-970e-fa4a3570fc9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88102) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:10:06.117252 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.fernet_utils [None req-ecfb5dca-0273-47b2-970e-fa4a3570fc9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88102) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:10:06.135002 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb5dca-0273-47b2-970e-fa4a3570fc9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:10:06.136670 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb5dca-0273-47b2-970e-fa4a3570fc9d service placement] RBAC: Authorization granted {{(pid=88102) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:10:06.148240 dv-cinder-844961-2-smb devstack@keystone.service[88102]: [pid: 88102|app: 0|req: 1479/2961] 10.222.0.18 () {60 vars in 1365 bytes} [Wed Aug 31 10:10:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:10:16.143156 dv-cinder-844961-2-smb devstack@keystone.service[88102]: DEBUG dbcounter [-] [88102] Writing DB stats keystone:SELECT=58 {{(pid=88102) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}